-- Logs begin at Tue 2021-07-13 01:50:45 UTC, end at Tue 2021-07-13 02:46:10 UTC. -- Jul 13 02:18:46.935216 dv-cinder-781024-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 13 02:18:46.943297 dv-cinder-781024-2-iscsi devstack@n-api.service[92164]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 13 02:18:46.945617 dv-cinder-781024-2-iscsi devstack@n-api.service[92164]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 13 02:18:46 2021] *** Jul 13 02:18:46.945617 dv-cinder-781024-2-iscsi devstack@n-api.service[92164]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 13 02:18:46.945617 dv-cinder-781024-2-iscsi devstack@n-api.service[92164]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 13 02:18:46.945617 dv-cinder-781024-2-iscsi devstack@n-api.service[92164]: nodename: dv-cinder-781024-2-iscsi Jul 13 02:18:46.945617 dv-cinder-781024-2-iscsi devstack@n-api.service[92164]: machine: x86_64 Jul 13 02:18:46.945617 dv-cinder-781024-2-iscsi devstack@n-api.service[92164]: clock source: unix Jul 13 02:18:46.945617 dv-cinder-781024-2-iscsi devstack@n-api.service[92164]: pcre jit disabled Jul 13 02:18:46.945617 dv-cinder-781024-2-iscsi devstack@n-api.service[92164]: detected number of CPU cores: 4 Jul 13 02:18:46.945617 dv-cinder-781024-2-iscsi devstack@n-api.service[92164]: current working directory: / Jul 13 02:18:46.945617 dv-cinder-781024-2-iscsi devstack@n-api.service[92164]: detected binary path: /usr/bin/uwsgi-core Jul 13 02:18:46.945617 dv-cinder-781024-2-iscsi devstack@n-api.service[92164]: your processes number limit is 47680 Jul 13 02:18:46.945617 dv-cinder-781024-2-iscsi devstack@n-api.service[92164]: your memory page size is 4096 bytes Jul 13 02:18:46.945617 dv-cinder-781024-2-iscsi devstack@n-api.service[92164]: detected max file descriptor number: 2048 Jul 13 02:18:46.945617 dv-cinder-781024-2-iscsi devstack@n-api.service[92164]: lock engine: pthread robust mutexes Jul 13 02:18:46.945617 dv-cinder-781024-2-iscsi devstack@n-api.service[92164]: thunder lock: enabled Jul 13 02:18:46.946519 dv-cinder-781024-2-iscsi devstack@n-api.service[92164]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 13 02:18:46.946519 dv-cinder-781024-2-iscsi devstack@n-api.service[92164]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Jul 13 02:18:46.990636 dv-cinder-781024-2-iscsi devstack@n-api.service[92164]: Python main interpreter initialized at 0x563ba6fd19c0 Jul 13 02:18:46.990636 dv-cinder-781024-2-iscsi devstack@n-api.service[92164]: python threads support enabled Jul 13 02:18:46.990636 dv-cinder-781024-2-iscsi devstack@n-api.service[92164]: your server socket listen backlog is limited to 100 connections Jul 13 02:18:46.990636 dv-cinder-781024-2-iscsi devstack@n-api.service[92164]: your mercy for graceful operations on workers is 90 seconds Jul 13 02:18:46.991014 dv-cinder-781024-2-iscsi devstack@n-api.service[92164]: mapped 403077 bytes (393 KB) for 2 cores Jul 13 02:18:46.991091 dv-cinder-781024-2-iscsi devstack@n-api.service[92164]: *** Operational MODE: preforking *** Jul 13 02:18:46.991337 dv-cinder-781024-2-iscsi devstack@n-api.service[92164]: *** uWSGI is running in multiple interpreter mode *** Jul 13 02:18:46.991337 dv-cinder-781024-2-iscsi devstack@n-api.service[92164]: spawned uWSGI master process (pid: 92164) Jul 13 02:18:46.991521 dv-cinder-781024-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 13 02:18:46.992907 dv-cinder-781024-2-iscsi devstack@n-api.service[92164]: spawned uWSGI worker 1 (pid: 92165, cores: 1) Jul 13 02:18:46.992907 dv-cinder-781024-2-iscsi devstack@n-api.service[92164]: spawned uWSGI worker 2 (pid: 92166, cores: 1) Jul 13 02:18:46.992907 dv-cinder-781024-2-iscsi devstack@n-api.service[92164]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 13 02:18:48.626847 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 02:18:48.626847 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: from cryptography.utils import int_from_bytes Jul 13 02:18:48.627520 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 02:18:48.627520 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: from cryptography.utils import int_from_bytes Jul 13 02:18:48.628037 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 02:18:48.628037 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: from cryptography.utils import int_from_bytes Jul 13 02:18:48.628182 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 02:18:48.628182 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: from cryptography.utils import int_from_bytes Jul 13 02:18:51.313511 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 13 02:18:51.314068 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 13 02:18:51.314157 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 13 02:18:51.314518 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 13 02:18:51.314599 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 13 02:18:51.314674 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 13 02:18:51.314781 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 13 02:18:51.314849 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 13 02:18:51.315026 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 13 02:18:51.315124 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.315244 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 13 02:18:51.315447 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.315632 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.315770 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.315968 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.316088 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.316294 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.316420 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.316617 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.316731 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.316951 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.317045 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.317264 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.317350 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.317586 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.317671 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.317911 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.317997 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.318248 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.318349 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.318519 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.318617 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-781024-2-iscsi {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.318835 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.318928 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.319162 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-781024-2-iscsi {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.319256 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.319468 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.319553 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.319781 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.319874 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.320080 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.320164 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.320399 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.320489 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.320702 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.320807 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.321022 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.321199 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.321709 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.321841 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.321958 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.322116 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.322237 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.322399 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.322521 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.322734 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.322837 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.323120 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.323207 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.323439 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.323546 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.323750 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.323845 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.324057 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.324147 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.324367 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.324453 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.324680 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.324773 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.324992 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.325095 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-781024-2-iscsi {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.325381 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.325488 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-781024-2-iscsi {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.325694 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.325790 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.326006 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.326240 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.326327 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.326421 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.326735 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.326865 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.327044 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.327140 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.327355 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.327482 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.327672 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.327759 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.327981 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.328068 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.328288 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.328373 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.328612 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.328737 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.328931 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.329028 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.329242 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.329337 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.329543 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.329636 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.329851 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.329947 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.330182 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.330330 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.330492 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.330585 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.330792 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.330880 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.331094 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.331190 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.331342 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.331435 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.331637 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.331733 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.331949 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.332045 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.332265 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.332357 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.332584 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.332672 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.332835 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.332930 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.333085 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.333172 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.333379 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.333558 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.333704 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.333829 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.334009 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.334126 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.334338 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.334450 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.334644 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.334737 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.334946 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.335054 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.335251 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.335346 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.335553 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.335646 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.335857 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.335945 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.336161 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.336256 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.336466 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.336551 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.336775 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.336860 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.337689 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.337779 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.338032 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.338119 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.338356 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.338453 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.338683 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.338794 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.339021 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.339114 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.339323 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.339416 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.339636 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.339730 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.339961 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.340053 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.340268 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.340370 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.340581 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.340674 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.340897 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.340989 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.341205 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.341309 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.341511 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.341613 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.341816 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.341908 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.342151 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.342263 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.342475 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.342577 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.342775 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.342868 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.343024 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.343127 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.343326 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.343420 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.343627 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.343733 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.343938 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.344040 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.344241 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.344328 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.344547 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.344635 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.344851 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.344948 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.345148 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.345235 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.345447 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.345540 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.345751 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.345837 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.346168 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.346270 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.346392 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.346497 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.346699 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.346785 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.346999 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.347083 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.347304 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.347389 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.347606 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.347692 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.347909 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.347996 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.348212 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.348297 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.348526 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.348619 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.348834 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.348931 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.349140 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.349235 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.349444 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.349546 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.349746 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.349854 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.350067 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.350179 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.350380 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.350481 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.350685 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.350778 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.350994 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.351088 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.351294 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.351394 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.351597 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.351700 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.351904 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.351997 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.352212 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.352304 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.352558 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.353188 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.353392 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.353492 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.353702 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.353803 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.354002 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.354201 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.354340 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.354444 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.354659 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.354748 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.354965 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.355052 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.355269 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.355364 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.355572 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.355665 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.355874 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.356055 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.356178 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.356378 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.356482 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.356691 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.356788 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.357002 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.357078 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.357311 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.357399 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.357615 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.357701 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.357938 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.358083 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.358289 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.358376 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.358589 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.358674 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.358908 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.359025 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.359221 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.359328 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.359542 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:18:51.359636 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.359879 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.359973 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.360193 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.360289 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.360524 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.360611 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.360846 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.360941 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.361161 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.361246 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.361474 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.361568 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.361792 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.361911 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.362129 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.362230 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.362452 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.362538 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.362769 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.362856 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.363086 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.363219 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.363404 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.363548 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.363721 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.363994 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.364132 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.364314 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.364402 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.364636 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.364740 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.364969 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.365065 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.365289 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.365377 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.365610 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.365706 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.365927 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.366014 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.366276 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.366368 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.366606 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.366708 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.366920 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.367006 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.367232 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.367318 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.367575 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.367671 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.367888 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.367973 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.368239 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.368336 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.368682 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.368797 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.369006 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.369146 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.369332 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.369466 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.369652 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.369782 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.369970 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.370113 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.370313 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.370436 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.370637 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.370753 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.370954 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.371070 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.371270 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.371408 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.371609 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.371730 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.371932 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.372049 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.372251 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.372522 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.372616 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.372857 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.372942 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.373165 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.373259 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.373478 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.373566 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.373786 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.373873 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.374131 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.374212 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.374470 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.374614 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.374777 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.374942 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.375106 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.375182 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.375411 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.375492 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.375722 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.375796 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.376032 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.376120 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.376339 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.376441 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.376652 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.376737 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.376966 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.377068 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.377271 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.377364 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.377593 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.377678 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.377905 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.377999 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.378241 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.378325 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.378563 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.378649 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.378872 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.378972 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.379181 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.379288 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.379494 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.379580 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.379805 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.379900 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.380117 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.380202 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.380429 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.380514 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.380754 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.380849 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.381070 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.381169 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.381384 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.381470 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.381719 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.381806 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.382076 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.382169 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.382396 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.382482 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.382724 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.382810 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.383051 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.383136 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.383369 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.383458 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.383675 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.383789 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.384014 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.384107 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.384326 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.384445 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.384893 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.385019 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.385204 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.385327 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.385520 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.385690 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.385830 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.385939 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.386167 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.386256 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.386477 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.386577 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.386782 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.386868 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.387089 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.387174 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.387415 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.387510 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.387730 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.387816 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.388037 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.388130 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.388339 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.388434 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.388644 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.388729 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.388983 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.389077 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.389291 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.389397 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.389621 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.389706 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.389935 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.390054 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.390283 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.390371 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.390606 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.390693 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.390919 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.391012 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.391225 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.391311 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.391533 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.391619 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.391843 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.391928 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.392165 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.392252 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.392475 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.392562 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.392785 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.392869 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.393090 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.393177 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.393399 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.393483 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.393721 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.393816 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.394076 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.394190 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.394394 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.394713 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.395037 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.395351 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.395665 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.395997 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.396155 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.396459 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.396549 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.396774 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.396863 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.397089 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.397176 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.397422 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.397507 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.397750 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.397935 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.398087 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.398405 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.398489 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.398725 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.398910 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.399050 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.399977 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.400118 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.400300 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.400619 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.400713 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.400995 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.401081 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.401318 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.401563 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.401658 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.401937 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.402079 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.402286 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.402574 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.402672 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.402930 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.403059 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.403261 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.403565 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.403651 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.403889 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.404070 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.404200 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.404531 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.404615 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.404849 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.404995 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.405166 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.405477 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.405563 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.405788 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.405961 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.406163 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.406404 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.406516 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.406778 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.406881 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.407101 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.407213 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.407429 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.407633 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.407728 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.407951 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.408047 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.408263 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.408358 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.408588 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.408683 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.408915 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.409010 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.409234 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.409324 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.409557 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.409646 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.409872 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.409966 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.410212 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.410302 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.410524 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.410609 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.410842 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.410941 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.411157 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.411243 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.411470 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.411563 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.411782 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.411881 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.412096 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.412181 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.412408 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.412495 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.412725 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.412820 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.413042 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.413134 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.413359 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.413627 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.413727 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.413968 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.414120 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.414307 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.414393 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.414628 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.414724 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.414951 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.415309 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.415403 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.415651 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.415738 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.415975 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.416072 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.416295 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.416392 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.416609 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.416704 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.416928 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.417016 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.417239 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.417327 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.417549 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.417644 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.417871 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.417958 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.418208 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.418304 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.418520 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.418679 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.418828 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.418913 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.419138 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.419224 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.419444 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.419543 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.419750 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.419842 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.420055 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.420182 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.420360 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.420454 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.420674 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.420761 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.420978 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.421063 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.421281 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.421375 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.421586 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.421671 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.421892 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.421977 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.422234 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.422322 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.422538 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.422622 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.422844 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.422929 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.423151 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.423239 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.423471 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.423557 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.423783 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.423869 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.424119 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.424206 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.424450 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.424536 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.424760 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.424845 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.425091 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.425177 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.425401 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.425498 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.425729 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.425824 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.426065 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.426168 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.426375 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.426495 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.426687 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.426796 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.426994 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.427080 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.427305 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.427390 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.427612 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.427711 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.427919 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.428004 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.428225 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.428319 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.428534 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.428629 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.428840 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.428927 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.429141 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.429227 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.429446 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.429531 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.429760 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.429855 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.430092 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.430182 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.430401 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.430486 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.431244 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.431417 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.431543 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.431676 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.431850 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.431931 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.432136 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.432238 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.432441 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.432536 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.432748 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.432835 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.433050 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.433145 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.433358 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.433444 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.433661 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.433746 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.433967 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.434107 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.434304 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.434392 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.434605 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.434691 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.434915 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.435002 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.435219 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.435305 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.435524 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.435615 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.435827 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.435914 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.436136 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.436231 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.436448 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.436558 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.436752 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.436849 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.437052 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.437138 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.437354 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.437447 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.437657 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.437752 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.437958 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.438066 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.438291 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.438378 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.438594 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.438683 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.438898 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.438984 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.439202 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.439297 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.439507 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.439634 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.439808 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.439894 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.440125 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.440220 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.440436 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.440522 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.440741 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.440828 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.441048 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.441144 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.441351 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.441437 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.441692 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.441777 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.441995 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.442143 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.442336 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.442429 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.442651 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.442738 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.442959 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.443129 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.443273 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.443368 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.443586 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.443672 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.443898 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.443986 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.444203 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.444289 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.444505 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.444599 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.444822 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.444910 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.445133 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.445220 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.445444 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.445583 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.445750 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.445845 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.446074 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.446167 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.446479 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.446665 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.446768 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.446887 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.447056 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.447207 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.447372 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.447532 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.447684 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.447855 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.448005 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.448182 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.448319 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.448492 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.448634 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.448804 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.448952 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.449119 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.449269 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.449432 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.449584 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.449745 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.449900 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.450076 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.450236 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.450396 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.450550 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.450714 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.450861 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.451030 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.451169 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.451344 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.451496 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.451659 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.451810 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.451969 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.452120 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.452280 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.452434 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.452592 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.452742 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.452900 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.453060 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.453224 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.453367 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.453543 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.453802 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.453888 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.454170 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.454263 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.454477 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.454564 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.454792 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.454879 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.455100 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.455195 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.455469 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.455556 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.455807 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.455911 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.456104 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.456192 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.456412 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.456500 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.456738 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.456864 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.457053 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.457182 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.457373 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.457499 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.457691 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.457820 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.457997 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.458149 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.458438 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.458525 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.458750 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.458850 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.459060 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.459146 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.459372 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.459457 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.459677 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.459772 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.459981 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.460067 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.460291 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.460376 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.460597 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.460692 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.460905 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.460991 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.461210 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.461324 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.461516 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.461638 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.461838 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.462538 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.462919 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.463008 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.463250 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.463345 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.463590 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.463683 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.463919 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.464007 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.464348 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.464440 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.464557 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.464671 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.464869 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.464991 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.465190 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.465306 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.465506 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.465628 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.465833 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.465934 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.466187 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.466278 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.466506 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.466594 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.466827 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.466922 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.467138 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.467225 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.467465 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.467552 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.467790 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.467889 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.468100 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.468185 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.468421 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.468507 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.468732 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.468828 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.469059 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.469153 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.469385 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.469471 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.469702 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.469789 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.470041 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.470129 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.470382 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.470468 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.470694 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.470782 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.471008 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.471102 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.471319 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.471413 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.471632 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.471720 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.471958 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.472051 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.472268 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.472367 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.472580 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.472666 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.472890 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.472977 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.473200 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.473361 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.473508 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.473603 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.473813 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.473898 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.474158 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.474263 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.474465 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.474559 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.474774 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.474866 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.475082 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.475181 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.475390 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.475476 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.475708 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.475832 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.476015 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.476111 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.476334 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.476420 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.476644 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.476730 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.476946 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.477040 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.477251 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.477337 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.477619 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.477713 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.477972 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.478189 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.478308 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.478512 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.478633 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.478825 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.478968 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.479134 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.479299 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.479442 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.479614 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.479787 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.479950 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.480085 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.480280 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.480405 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.480601 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.480738 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.480926 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.481068 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.481253 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.481380 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.481564 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.481718 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.481873 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.482074 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.482217 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.482390 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.482527 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.482713 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.482838 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.483040 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.483136 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.483348 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.483443 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.483654 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.483742 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.483970 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.484073 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.484285 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.484372 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.484594 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.484685 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.484900 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.484989 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.485214 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.485300 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.485520 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.485614 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.485825 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.485950 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.486153 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.486241 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.486460 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.486548 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.486769 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.486856 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.487093 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.487180 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.487405 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.487500 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.487710 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.487797 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.488016 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.488103 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.488322 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.488418 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.488665 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.488752 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.488973 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.489060 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.489299 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.489394 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.489615 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.489700 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.489931 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.490017 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.490277 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.490383 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.490590 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.490676 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.490905 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.490991 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.491223 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.491322 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.491535 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.491628 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.491851 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.491938 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.492169 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.492268 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.492482 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.492568 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.492799 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.493006 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.493103 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.493868 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.494004 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.494217 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.494329 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.494538 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.494659 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.494855 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.494980 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.495182 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.495501 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.495587 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.495816 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.495905 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.496132 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.496220 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.496447 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.496544 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.496762 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.496849 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.497083 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.497223 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.497403 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.497502 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.497719 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.497808 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.498060 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.498153 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.498374 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.498477 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.498689 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.498778 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.499020 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.499107 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.499343 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.499436 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.499669 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.499756 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.500011 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.500106 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.500323 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.500412 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.500639 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.500731 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.500958 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.501099 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.501278 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.501374 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.501598 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.501686 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.501921 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.502017 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.502264 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.502352 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.502586 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.502673 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.502905 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.502993 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.503221 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.503308 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.503538 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.503624 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.503853 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.503941 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.504169 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.504254 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.504496 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.504591 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.504816 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.504904 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.505129 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.505214 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.505446 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.505533 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.505761 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.505848 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.506115 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.506309 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.506460 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.506627 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.506785 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.506964 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.507101 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.507292 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.507417 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.507618 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.507736 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.507942 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.508258 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.508345 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.508577 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.508677 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.509435 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.509785 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.510004 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.510158 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.510341 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.510447 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.510656 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.510744 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.510964 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.511052 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.511288 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.511377 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.511598 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.511684 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.511903 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.511990 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.512212 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.512298 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.512521 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.512615 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.512822 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.513061 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.513431 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.513522 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.513603 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.513720 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.513808 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.514069 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.514174 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.514382 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.514517 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.514701 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.514917 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.515085 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.515269 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.515362 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.515587 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.515681 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.515914 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.516009 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.516237 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.516331 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.516553 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.516638 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.516858 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.516954 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.517164 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.517258 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.517473 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.517562 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.517780 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.517878 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.518104 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.518193 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.518422 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.518510 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.518731 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.518819 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.519039 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.519126 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.519351 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.519438 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.519655 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.519749 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.519959 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.520045 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.520268 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.520354 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.520572 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.520662 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.520875 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.520961 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.521184 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.521278 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.521487 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.521575 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.521793 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.521880 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.522125 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.522217 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.522431 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.522525 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.522735 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.522829 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.523038 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.523133 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.523342 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.523429 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.523653 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.523740 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.523956 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.524051 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.524270 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.524356 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.524624 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.524714 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.524927 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.525027 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.525322 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.525408 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.525645 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.525743 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.525949 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.526065 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.526299 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.526388 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.526609 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.526696 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.526915 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.527015 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.527234 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.527323 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.527548 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.527810 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.527907 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.528152 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.528247 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.528467 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.528554 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.528809 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.528908 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.529125 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.529220 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.529446 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.529659 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.529747 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.529991 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.530108 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.530336 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.530424 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.530679 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.530796 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.530989 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.531077 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.531303 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.531398 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.531606 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.531704 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.531911 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.532006 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.532221 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.532309 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.532530 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.532629 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.532838 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.532925 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.533149 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.533235 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.533456 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.533552 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.533764 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.533994 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.534163 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.534349 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.534437 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.534679 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.534767 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.534997 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.535082 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.535310 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.535408 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.535624 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.535840 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.535935 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.536171 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.536286 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.536494 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.536608 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.536852 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.537063 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.537185 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.537388 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.537487 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.537706 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.537794 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.538073 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.538235 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.538359 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.538557 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.538677 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.538882 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.538997 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.539208 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.539327 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.539523 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.539618 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.539872 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.539959 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.540867 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.541173 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.541269 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.541496 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.541582 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.541820 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.541914 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.542161 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.542252 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.542479 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.542565 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.542792 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.542894 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.543110 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.543197 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.543460 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.543548 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.543764 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.543859 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.544071 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.544158 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.544383 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.544471 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.544697 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.544792 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.545041 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.545128 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.545358 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.545443 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.545681 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.545847 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.545999 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.546118 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.546341 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.546430 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.546664 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.546751 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.546981 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.547075 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.547294 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.547381 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.547609 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.547697 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.547921 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.548007 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.548242 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.548329 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.548553 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.548643 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.548871 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.548958 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.549181 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.549273 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.549494 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.549582 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.549803 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.549896 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.550169 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.550271 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.550492 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.550581 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.550818 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.550905 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.551133 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.551227 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.551449 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.551577 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.551761 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.551847 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.552087 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.552183 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.552410 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.552497 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.552720 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.552807 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.553034 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.553129 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.553344 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.553437 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.553669 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.553756 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.553983 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.554096 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.554323 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.554410 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.554641 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.554727 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.554953 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.555041 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.555269 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.555357 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.555580 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.556253 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.556428 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.556517 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.556740 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.556830 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.557041 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.557129 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.557351 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.557441 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.557680 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.557826 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.558002 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.558136 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.558333 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.558428 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.558660 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.558748 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.558974 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.559069 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.559294 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.559382 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.559605 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.559700 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.559917 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.560012 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.560234 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.560321 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.560547 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.560632 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.560865 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.560960 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.561178 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.561265 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.561490 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.561578 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.561807 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.561896 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.562152 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.562244 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.562481 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.562568 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.562806 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.562896 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.563137 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.563223 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.563384 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92165) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 13 02:18:51.563472 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.563831 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.564102 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.564452 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.564781 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:18:51.565025 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=92166) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 13 02:18:51.585829 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG oslo_db.sqlalchemy.engines [None req-43434228-6113-4ade-91a6-9526a4d732f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92165) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 02:18:51.586804 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG oslo_db.sqlalchemy.engines [None req-ca1084fd-1964-4eed-9be5-a4ceee430a46 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92166) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 02:18:51.664586 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.context [None req-43434228-6113-4ade-91a6-9526a4d732f3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),94e222e8-b2ee-400d-b98b-1757bb81f73f(cell1) {{(pid=92165) load_cells /opt/stack/nova/nova/context.py:464}} Jul 13 02:18:51.664799 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.context [None req-ca1084fd-1964-4eed-9be5-a4ceee430a46 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),94e222e8-b2ee-400d-b98b-1757bb81f73f(cell1) {{(pid=92166) load_cells /opt/stack/nova/nova/context.py:464}} Jul 13 02:18:51.669388 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG oslo_concurrency.lockutils [None req-ca1084fd-1964-4eed-9be5-a4ceee430a46 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:18:51.669554 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG oslo_concurrency.lockutils [None req-43434228-6113-4ade-91a6-9526a4d732f3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:18:51.671058 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG oslo_concurrency.lockutils [None req-ca1084fd-1964-4eed-9be5-a4ceee430a46 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:18:51.671168 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG oslo_concurrency.lockutils [None req-43434228-6113-4ade-91a6-9526a4d732f3 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:18:51.671849 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG oslo_concurrency.lockutils [None req-ca1084fd-1964-4eed-9be5-a4ceee430a46 None None] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:18:51.671944 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG oslo_concurrency.lockutils [None req-43434228-6113-4ade-91a6-9526a4d732f3 None None] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:18:51.673782 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG oslo_concurrency.lockutils [None req-ca1084fd-1964-4eed-9be5-a4ceee430a46 None None] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:18:51.673881 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG oslo_concurrency.lockutils [None req-43434228-6113-4ade-91a6-9526a4d732f3 None None] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=92165) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:18:51.684976 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG oslo_db.sqlalchemy.engines [None req-ca1084fd-1964-4eed-9be5-a4ceee430a46 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92166) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 02:18:51.687631 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG oslo_db.sqlalchemy.engines [None req-43434228-6113-4ade-91a6-9526a4d732f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92165) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 02:18:51.689802 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG oslo_db.sqlalchemy.engines [None req-43434228-6113-4ade-91a6-9526a4d732f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92165) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 02:18:51.694263 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG oslo_db.sqlalchemy.engines [None req-ca1084fd-1964-4eed-9be5-a4ceee430a46 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92166) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 02:18:51.706979 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: /opt/stack/nova/nova/db/sqlalchemy/api.py:439: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:18:51.706979 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: return dict(min_versions) Jul 13 02:18:51.707631 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: /opt/stack/nova/nova/db/sqlalchemy/api.py:439: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:18:51.707631 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: return dict(min_versions) Jul 13 02:18:52.050404 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG oslo_db.sqlalchemy.engines [None req-ca1084fd-1964-4eed-9be5-a4ceee430a46 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92166) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 02:18:52.053164 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG oslo_db.sqlalchemy.engines [None req-43434228-6113-4ade-91a6-9526a4d732f3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92165) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 02:18:52.061768 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: /opt/stack/nova/nova/db/sqlalchemy/api.py:505: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:18:52.061768 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: result = model_query(context, models.Service, read_deleted="no").\ Jul 13 02:18:52.064058 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: /opt/stack/nova/nova/db/sqlalchemy/api.py:505: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:18:52.064058 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: result = model_query(context, models.Service, read_deleted="no").\ Jul 13 02:18:52.396912 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: WARNING keystonemiddleware.auth_token [None req-ca1084fd-1964-4eed-9be5-a4ceee430a46 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 13 02:18:52.397439 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: WARNING keystonemiddleware.auth_token [None req-43434228-6113-4ade-91a6-9526a4d732f3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 13 02:18:52.403675 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: WARNING keystonemiddleware.auth_token [None req-ca1084fd-1964-4eed-9be5-a4ceee430a46 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 13 02:18:52.403968 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: WARNING keystonemiddleware.auth_token [None req-43434228-6113-4ade-91a6-9526a4d732f3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 13 02:18:52.749266 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: WARNING keystonemiddleware.auth_token [None req-ca1084fd-1964-4eed-9be5-a4ceee430a46 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 13 02:18:52.749519 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: WARNING keystonemiddleware.auth_token [None req-43434228-6113-4ade-91a6-9526a4d732f3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 13 02:18:52.754438 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: WARNING keystonemiddleware.auth_token [None req-ca1084fd-1964-4eed-9be5-a4ceee430a46 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 13 02:18:52.754560 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: WARNING keystonemiddleware.auth_token [None req-43434228-6113-4ade-91a6-9526a4d732f3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 13 02:18:52.760102 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563ba6fd19c0 pid: 92166 (default app) Jul 13 02:18:52.760241 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563ba6fd19c0 pid: 92165 (default app) Jul 13 02:18:52.762184 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi [None req-ca1084fd-1964-4eed-9be5-a4ceee430a46 None None] Calling method '>' {{(pid=92166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:18:52.763383 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: INFO nova.api.openstack.requestlog [None req-ca1084fd-1964-4eed-9be5-a4ceee430a46 None None] 10.222.0.32 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001760 Jul 13 02:18:52.763823 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: [pid: 92166|app: 0|req: 1/1] 10.222.0.32 () {50 vars in 789 bytes} [Tue Jul 13 02:18:52 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:20:11.461444 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi [None req-43434228-6113-4ade-91a6-9526a4d732f3 None None] Calling method '>' {{(pid=92165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:20:11.462738 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: INFO nova.api.openstack.requestlog [None req-43434228-6113-4ade-91a6-9526a4d732f3 None None] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002025 Jul 13 02:20:11.463146 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: [pid: 92165|app: 0|req: 1/2] 10.222.0.32 () {54 vars in 931 bytes} [Tue Jul 13 02:20:11 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:20:11.881935 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi [None req-271c2b33-028e-4753-87b9-c6f280c2ce1a admin admin] Calling method '>' {{(pid=92166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:20:11.911386 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: INFO nova.api.openstack.requestlog [None req-271c2b33-028e-4753-87b9-c6f280c2ce1a admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.442428 Jul 13 02:20:11.912146 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: [pid: 92166|app: 0|req: 2/3] 10.222.0.32 () {60 vars in 1292 bytes} [Tue Jul 13 02:20:11 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:20:14.089887 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi [None req-43434228-6113-4ade-91a6-9526a4d732f3 None None] Calling method '>' {{(pid=92165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:20:14.090963 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: INFO nova.api.openstack.requestlog [None req-43434228-6113-4ade-91a6-9526a4d732f3 None None] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Jul 13 02:20:14.091532 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: [pid: 92165|app: 0|req: 2/4] 10.222.0.32 () {54 vars in 931 bytes} [Tue Jul 13 02:20:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:20:14.155107 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi [None req-07215234-2cf0-473c-9958-46174629b946 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "id": "c1", "name": "cirros256", "ram": 256, "os-flavor-access:is_public": true, "disk": 1}} {{(pid=92166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:20:14.173430 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:20:14.173430 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: warnings.warn(msg) Jul 13 02:20:14.202833 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: INFO nova.api.openstack.requestlog [None req-07215234-2cf0-473c-9958-46174629b946 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.104729 Jul 13 02:20:14.203943 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: [pid: 92166|app: 0|req: 3/5] 10.222.0.32 () {64 vars in 1283 bytes} [Tue Jul 13 02:20:14 2021] POST /compute/v2.1/flavors => generated 407 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:20:14.421811 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi [None req-5fea7a89-8dd2-4a39-9704-ec1a250565e0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:20:14.424649 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:20:14.424649 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: warnings.warn(msg) Jul 13 02:20:14.472734 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: INFO nova.api.openstack.requestlog [None req-5fea7a89-8dd2-4a39-9704-ec1a250565e0 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.260122 Jul 13 02:20:14.486060 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: [pid: 92165|app: 0|req: 3/6] 10.222.0.32 () {64 vars in 1336 bytes} [Tue Jul 13 02:20:14 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:20:16.650566 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi [None req-07215234-2cf0-473c-9958-46174629b946 admin admin] Calling method '>' {{(pid=92166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:20:16.651667 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: INFO nova.api.openstack.requestlog [None req-07215234-2cf0-473c-9958-46174629b946 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001576 Jul 13 02:20:16.652267 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: [pid: 92166|app: 0|req: 4/7] 10.222.0.32 () {54 vars in 931 bytes} [Tue Jul 13 02:20:16 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:20:16.757423 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi [None req-901928b9-0353-40b1-bcfb-f00ab665267d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 5, "swap": 0, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "vcpus": 1, "id": "d1"}} {{(pid=92165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:20:16.775881 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:20:16.775881 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: warnings.warn(msg) Jul 13 02:20:16.796278 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: INFO nova.api.openstack.requestlog [None req-901928b9-0353-40b1-bcfb-f00ab665267d admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.138304 Jul 13 02:20:16.797067 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: [pid: 92165|app: 0|req: 4/8] 10.222.0.32 () {64 vars in 1283 bytes} [Tue Jul 13 02:20:16 2021] POST /compute/v2.1/flavors => generated 404 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:20:16.810104 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi [None req-59eec53b-805d-48ba-be15-385061175137 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:20:16.811657 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:20:16.811657 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: warnings.warn(msg) Jul 13 02:20:16.865862 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: INFO nova.api.openstack.requestlog [None req-59eec53b-805d-48ba-be15-385061175137 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.059229 Jul 13 02:20:16.870095 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: [pid: 92166|app: 0|req: 5/9] 10.222.0.32 () {64 vars in 1336 bytes} [Tue Jul 13 02:20:16 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:20:19.093436 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi [None req-901928b9-0353-40b1-bcfb-f00ab665267d admin admin] Calling method '>' {{(pid=92165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:20:19.094476 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: INFO nova.api.openstack.requestlog [None req-901928b9-0353-40b1-bcfb-f00ab665267d admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jul 13 02:20:19.094880 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: [pid: 92165|app: 0|req: 5/10] 10.222.0.32 () {54 vars in 931 bytes} [Tue Jul 13 02:20:19 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:20:19.153704 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi [None req-40c28c51-9a37-443f-a520-f414ef3a0276 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "name": "ds1G", "vcpus": 1, "id": "d2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10}} {{(pid=92166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:20:19.172925 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: INFO nova.api.openstack.requestlog [None req-40c28c51-9a37-443f-a520-f414ef3a0276 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071165 Jul 13 02:20:19.173469 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: [pid: 92166|app: 0|req: 6/11] 10.222.0.32 () {64 vars in 1283 bytes} [Tue Jul 13 02:20:19 2021] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:20:19.186453 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi [None req-5a482e10-fbc9-49c9-b875-979d68dbc50f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:20:19.211238 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: INFO nova.api.openstack.requestlog [None req-5a482e10-fbc9-49c9-b875-979d68dbc50f admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028524 Jul 13 02:20:19.212020 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: [pid: 92165|app: 0|req: 6/12] 10.222.0.32 () {64 vars in 1336 bytes} [Tue Jul 13 02:20:19 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:20:21.485320 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi [None req-40c28c51-9a37-443f-a520-f414ef3a0276 admin admin] Calling method '>' {{(pid=92166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:20:21.488439 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: INFO nova.api.openstack.requestlog [None req-40c28c51-9a37-443f-a520-f414ef3a0276 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003454 Jul 13 02:20:21.490652 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: [pid: 92166|app: 0|req: 7/13] 10.222.0.32 () {54 vars in 931 bytes} [Tue Jul 13 02:20:21 2021] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:20:21.561500 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi [None req-d8722c49-24a4-44ca-8070-5c1ada965a69 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d3", "os-flavor-access:is_public": true, "name": "ds2G", "vcpus": 2, "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=92165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:20:21.579771 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: INFO nova.api.openstack.requestlog [None req-d8722c49-24a4-44ca-8070-5c1ada965a69 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.082769 Jul 13 02:20:21.580325 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: [pid: 92165|app: 0|req: 7/14] 10.222.0.32 () {64 vars in 1283 bytes} [Tue Jul 13 02:20:21 2021] POST /compute/v2.1/flavors => generated 404 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 13 02:20:21.592240 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi [None req-c0fc77a4-a6ee-4bcb-b12e-b6640f9051cc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:20:21.614954 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: INFO nova.api.openstack.requestlog [None req-c0fc77a4-a6ee-4bcb-b12e-b6640f9051cc admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026283 Jul 13 02:20:21.616809 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: [pid: 92166|app: 0|req: 8/15] 10.222.0.32 () {64 vars in 1336 bytes} [Tue Jul 13 02:20:21 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:20:23.794632 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi [None req-d8722c49-24a4-44ca-8070-5c1ada965a69 admin admin] Calling method '>' {{(pid=92165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:20:23.795627 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: INFO nova.api.openstack.requestlog [None req-d8722c49-24a4-44ca-8070-5c1ada965a69 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jul 13 02:20:23.796209 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: [pid: 92165|app: 0|req: 8/16] 10.222.0.32 () {54 vars in 931 bytes} [Tue Jul 13 02:20:23 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:20:23.851166 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi [None req-68c956e6-edd1-4cac-9a17-959ee6a24826 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "id": "d4", "name": "ds4G", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 20, "swap": 0}} {{(pid=92166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:20:23.869223 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: INFO nova.api.openstack.requestlog [None req-68c956e6-edd1-4cac-9a17-959ee6a24826 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.067299 Jul 13 02:20:23.869967 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: [pid: 92166|app: 0|req: 9/17] 10.222.0.32 () {64 vars in 1283 bytes} [Tue Jul 13 02:20:23 2021] POST /compute/v2.1/flavors => generated 404 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:20:23.882157 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi [None req-b3b29500-e3cf-4ed9-b9ab-c6840b64082c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:20:23.907412 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: INFO nova.api.openstack.requestlog [None req-b3b29500-e3cf-4ed9-b9ab-c6840b64082c admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029657 Jul 13 02:20:23.908513 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: [pid: 92165|app: 0|req: 9/18] 10.222.0.32 () {64 vars in 1336 bytes} [Tue Jul 13 02:20:23 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:20:26.078442 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi [None req-68c956e6-edd1-4cac-9a17-959ee6a24826 admin admin] Calling method '>' {{(pid=92166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:20:26.079640 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: INFO nova.api.openstack.requestlog [None req-68c956e6-edd1-4cac-9a17-959ee6a24826 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001764 Jul 13 02:20:26.080311 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: [pid: 92166|app: 0|req: 10/19] 10.222.0.32 () {54 vars in 931 bytes} [Tue Jul 13 02:20:26 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 02:20:26.146447 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi [None req-419a56ac-4e87-4213-bd6b-62bbde1ace40 admin admin] Calling method '>' {{(pid=92165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:20:26.175810 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: INFO nova.api.openstack.requestlog [None req-419a56ac-4e87-4213-bd6b-62bbde1ace40 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.088778 Jul 13 02:20:26.176502 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: [pid: 92165|app: 0|req: 10/20] 10.222.0.32 () {60 vars in 1292 bytes} [Tue Jul 13 02:20:26 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:20:28.397136 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi [None req-68c956e6-edd1-4cac-9a17-959ee6a24826 admin admin] Calling method '>' {{(pid=92166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:20:28.398595 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: INFO nova.api.openstack.requestlog [None req-68c956e6-edd1-4cac-9a17-959ee6a24826 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002158 Jul 13 02:20:28.399088 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: [pid: 92166|app: 0|req: 11/21] 10.222.0.32 () {54 vars in 931 bytes} [Tue Jul 13 02:20:28 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:20:28.458080 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi [None req-104fb612-ba4b-4d24-8ad9-56aae1ba96f3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "disk": 1, "ram": 512, "name": "m1.tiny", "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=92165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:20:28.477454 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: INFO nova.api.openstack.requestlog [None req-104fb612-ba4b-4d24-8ad9-56aae1ba96f3 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.072265 Jul 13 02:20:28.478051 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: [pid: 92165|app: 0|req: 11/22] 10.222.0.32 () {64 vars in 1283 bytes} [Tue Jul 13 02:20:28 2021] POST /compute/v2.1/flavors => generated 402 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:20:28.489607 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi [None req-fbcb5946-da7a-4f2b-b8bc-73db1aad3248 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:20:28.513182 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: INFO nova.api.openstack.requestlog [None req-fbcb5946-da7a-4f2b-b8bc-73db1aad3248 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027288 Jul 13 02:20:28.513766 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: [pid: 92166|app: 0|req: 12/23] 10.222.0.32 () {64 vars in 1333 bytes} [Tue Jul 13 02:20:28 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:20:30.936309 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi [None req-104fb612-ba4b-4d24-8ad9-56aae1ba96f3 admin admin] Calling method '>' {{(pid=92165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:20:30.937317 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: INFO nova.api.openstack.requestlog [None req-104fb612-ba4b-4d24-8ad9-56aae1ba96f3 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Jul 13 02:20:30.937728 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: [pid: 92165|app: 0|req: 12/24] 10.222.0.32 () {54 vars in 931 bytes} [Tue Jul 13 02:20:30 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:20:30.995569 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi [None req-af06b0c8-1be9-4393-9fa6-07ad1b3d9b10 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "m1.small", "rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true, "id": "2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=92166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:20:31.014421 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: INFO nova.api.openstack.requestlog [None req-af06b0c8-1be9-4393-9fa6-07ad1b3d9b10 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.069312 Jul 13 02:20:31.014976 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: [pid: 92166|app: 0|req: 13/25] 10.222.0.32 () {64 vars in 1283 bytes} [Tue Jul 13 02:20:30 2021] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:20:31.027365 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi [None req-4eeccaaa-3da3-4e27-b11e-b435080fbbeb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:20:31.050409 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: INFO nova.api.openstack.requestlog [None req-4eeccaaa-3da3-4e27-b11e-b435080fbbeb admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026598 Jul 13 02:20:31.050978 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: [pid: 92165|app: 0|req: 13/26] 10.222.0.32 () {64 vars in 1333 bytes} [Tue Jul 13 02:20:31 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:20:33.347960 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi [None req-af06b0c8-1be9-4393-9fa6-07ad1b3d9b10 admin admin] Calling method '>' {{(pid=92166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:20:33.349122 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: INFO nova.api.openstack.requestlog [None req-af06b0c8-1be9-4393-9fa6-07ad1b3d9b10 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001581 Jul 13 02:20:33.349603 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: [pid: 92166|app: 0|req: 14/27] 10.222.0.32 () {54 vars in 931 bytes} [Tue Jul 13 02:20:33 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:20:33.405071 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi [None req-0d81f7cb-480f-46e5-956a-674290ffb903 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 40, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 2, "id": "3", "name": "m1.medium", "swap": 0}} {{(pid=92165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:20:33.422280 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: INFO nova.api.openstack.requestlog [None req-0d81f7cb-480f-46e5-956a-674290ffb903 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.066731 Jul 13 02:20:33.422828 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: [pid: 92165|app: 0|req: 14/28] 10.222.0.32 () {64 vars in 1283 bytes} [Tue Jul 13 02:20:33 2021] POST /compute/v2.1/flavors => generated 406 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:20:33.434709 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi [None req-76ea7e7b-9752-4fbb-b866-9bd22b1c294a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:20:33.457295 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: INFO nova.api.openstack.requestlog [None req-76ea7e7b-9752-4fbb-b866-9bd22b1c294a admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026112 Jul 13 02:20:33.457863 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: [pid: 92166|app: 0|req: 15/29] 10.222.0.32 () {64 vars in 1333 bytes} [Tue Jul 13 02:20:33 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:20:35.633015 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi [None req-0d81f7cb-480f-46e5-956a-674290ffb903 admin admin] Calling method '>' {{(pid=92165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:20:35.634279 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: INFO nova.api.openstack.requestlog [None req-0d81f7cb-480f-46e5-956a-674290ffb903 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jul 13 02:20:35.634691 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: [pid: 92165|app: 0|req: 15/30] 10.222.0.32 () {54 vars in 931 bytes} [Tue Jul 13 02:20:35 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 02:20:35.691916 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi [None req-f45a275f-57cb-4cce-8589-c43e873199a3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "ram": 8192, "os-flavor-access:is_public": true, "name": "m1.large", "disk": 80, "id": "4", "rxtx_factor": 1.0, "swap": 0}} {{(pid=92166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:20:35.710456 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: INFO nova.api.openstack.requestlog [None req-f45a275f-57cb-4cce-8589-c43e873199a3 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.069781 Jul 13 02:20:35.711015 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: [pid: 92166|app: 0|req: 16/31] 10.222.0.32 () {64 vars in 1283 bytes} [Tue Jul 13 02:20:35 2021] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:20:35.722481 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi [None req-d74ca7e4-3ee5-440c-af01-a49dc8f4fd76 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:20:35.744871 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: INFO nova.api.openstack.requestlog [None req-d74ca7e4-3ee5-440c-af01-a49dc8f4fd76 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025951 Jul 13 02:20:35.745447 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: [pid: 92165|app: 0|req: 16/32] 10.222.0.32 () {64 vars in 1333 bytes} [Tue Jul 13 02:20:35 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:20:37.948020 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi [None req-f45a275f-57cb-4cce-8589-c43e873199a3 admin admin] Calling method '>' {{(pid=92166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:20:37.949636 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: INFO nova.api.openstack.requestlog [None req-f45a275f-57cb-4cce-8589-c43e873199a3 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002058 Jul 13 02:20:37.950340 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: [pid: 92166|app: 0|req: 17/33] 10.222.0.32 () {54 vars in 931 bytes} [Tue Jul 13 02:20:37 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:20:38.010758 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi [None req-8d1bf882-0af9-4e45-bf97-0c8be769ea9d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "5", "vcpus": 8, "rxtx_factor": 1.0, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.xlarge", "disk": 160}} {{(pid=92165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:20:38.033924 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: INFO nova.api.openstack.requestlog [None req-8d1bf882-0af9-4e45-bf97-0c8be769ea9d admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.077611 Jul 13 02:20:38.034838 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: [pid: 92165|app: 0|req: 17/34] 10.222.0.32 () {64 vars in 1283 bytes} [Tue Jul 13 02:20:37 2021] POST /compute/v2.1/flavors => generated 408 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:20:38.047086 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi [None req-bb0bad54-4bc1-47a9-8eda-7a95476337f4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=92166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:20:38.074508 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: INFO nova.api.openstack.requestlog [None req-bb0bad54-4bc1-47a9-8eda-7a95476337f4 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031187 Jul 13 02:20:38.075310 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: [pid: 92166|app: 0|req: 18/35] 10.222.0.32 () {64 vars in 1333 bytes} [Tue Jul 13 02:20:38 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:21:17.089615 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi [None req-8d1bf882-0af9-4e45-bf97-0c8be769ea9d admin admin] Calling method '>' {{(pid=92165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:21:17.090666 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: INFO nova.api.openstack.requestlog [None req-8d1bf882-0af9-4e45-bf97-0c8be769ea9d admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jul 13 02:21:17.091065 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: [pid: 92165|app: 0|req: 18/36] 10.222.0.32 () {54 vars in 931 bytes} [Tue Jul 13 02:21:17 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:21:17.145459 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi [None req-1aca8450-373a-4577-9134-240247354850 admin admin] Calling method '>' {{(pid=92166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:21:17.162144 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: INFO nova.api.openstack.requestlog [None req-1aca8450-373a-4577-9134-240247354850 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.065345 Jul 13 02:21:17.162690 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: [pid: 92166|app: 0|req: 19/37] 10.222.0.32 () {60 vars in 1292 bytes} [Tue Jul 13 02:21:17 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:21:18.564931 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi [None req-8d1bf882-0af9-4e45-bf97-0c8be769ea9d admin admin] Calling method '>' {{(pid=92165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:21:18.565909 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: INFO nova.api.openstack.requestlog [None req-8d1bf882-0af9-4e45-bf97-0c8be769ea9d admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001393 Jul 13 02:21:18.566906 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: [pid: 92165|app: 0|req: 19/38] 10.222.0.32 () {56 vars in 1075 bytes} [Tue Jul 13 02:21:18 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:21:18.752412 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi [None req-cc430d23-0963-4544-a1cc-5db6ce78943d admin admin] Calling method '>' {{(pid=92166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:21:18.758307 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: INFO nova.api.openstack.wsgi [None req-cc430d23-0963-4544-a1cc-5db6ce78943d admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 13 02:21:18.759188 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi [None req-cc430d23-0963-4544-a1cc-5db6ce78943d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=92166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:21:18.759967 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: INFO nova.api.openstack.requestlog [None req-cc430d23-0963-4544-a1cc-5db6ce78943d admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.055260 Jul 13 02:21:18.760466 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: [pid: 92166|app: 0|req: 20/39] 10.222.0.32 () {60 vars in 1191 bytes} [Tue Jul 13 02:21:18 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 13 02:21:18.770074 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi [None req-aa629a7d-7630-4962-ae7b-776323c9523f admin admin] Calling method '>' {{(pid=92165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:21:18.790392 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: INFO nova.api.openstack.requestlog [None req-aa629a7d-7630-4962-ae7b-776323c9523f admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024328 Jul 13 02:21:18.790870 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: [pid: 92165|app: 0|req: 20/40] 10.222.0.32 () {60 vars in 1211 bytes} [Tue Jul 13 02:21:18 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:21:18.801651 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi [None req-6d7f6234-713e-4643-96f0-ba64e12d518b admin admin] Calling method '>' {{(pid=92166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:21:18.822801 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: INFO nova.api.openstack.requestlog [None req-6d7f6234-713e-4643-96f0-ba64e12d518b admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025692 Jul 13 02:21:18.823326 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: [pid: 92166|app: 0|req: 21/41] 10.222.0.32 () {60 vars in 1211 bytes} [Tue Jul 13 02:21:18 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:21:18.833134 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi [None req-239e8679-1ff0-4656-b0c0-00e747a183ba admin admin] Calling method '>' {{(pid=92165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:21:18.838390 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: INFO nova.api.openstack.wsgi [None req-239e8679-1ff0-4656-b0c0-00e747a183ba admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 13 02:21:18.838942 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi [None req-239e8679-1ff0-4656-b0c0-00e747a183ba admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=92165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:21:18.839708 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: INFO nova.api.openstack.requestlog [None req-239e8679-1ff0-4656-b0c0-00e747a183ba admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.010782 Jul 13 02:21:18.840197 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: [pid: 92165|app: 0|req: 21/42] 10.222.0.32 () {60 vars in 1191 bytes} [Tue Jul 13 02:21:18 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 13 02:21:20.267565 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi [None req-6d7f6234-713e-4643-96f0-ba64e12d518b admin admin] Calling method '>' {{(pid=92166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:21:20.268553 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: INFO nova.api.openstack.requestlog [None req-6d7f6234-713e-4643-96f0-ba64e12d518b admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jul 13 02:21:20.268946 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: [pid: 92166|app: 0|req: 22/43] 10.222.0.32 () {56 vars in 1075 bytes} [Tue Jul 13 02:21:20 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:21:20.458880 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi [None req-aa018915-79af-420e-a45a-b4d034d568df admin admin] Calling method '>' {{(pid=92165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:21:20.464143 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: INFO nova.api.openstack.wsgi [None req-aa018915-79af-420e-a45a-b4d034d568df admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 13 02:21:20.464702 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi [None req-aa018915-79af-420e-a45a-b4d034d568df admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=92165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:21:20.465484 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: INFO nova.api.openstack.requestlog [None req-aa018915-79af-420e-a45a-b4d034d568df admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.056509 Jul 13 02:21:20.466000 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: [pid: 92165|app: 0|req: 22/44] 10.222.0.32 () {60 vars in 1191 bytes} [Tue Jul 13 02:21:20 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 13 02:21:20.476151 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi [None req-fa962430-8f57-46ed-9d2c-d180537f2c07 admin admin] Calling method '>' {{(pid=92166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:21:20.489756 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: INFO nova.api.openstack.requestlog [None req-fa962430-8f57-46ed-9d2c-d180537f2c07 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.018130 Jul 13 02:21:20.490326 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: [pid: 92166|app: 0|req: 23/45] 10.222.0.32 () {60 vars in 1211 bytes} [Tue Jul 13 02:21:20 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:21:20.499628 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi [None req-299b6401-2697-49ab-9abb-0ef31e913a72 admin admin] Calling method '>' {{(pid=92165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:21:20.513752 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: INFO nova.api.openstack.requestlog [None req-299b6401-2697-49ab-9abb-0ef31e913a72 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017510 Jul 13 02:21:20.514259 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: [pid: 92165|app: 0|req: 23/46] 10.222.0.32 () {60 vars in 1211 bytes} [Tue Jul 13 02:21:20 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:21:20.524377 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi [None req-346c91f5-a9b3-4471-bf04-fec9731eb55b admin admin] Calling method '>' {{(pid=92166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:21:20.529465 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: INFO nova.api.openstack.wsgi [None req-346c91f5-a9b3-4471-bf04-fec9731eb55b admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 13 02:21:20.530015 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi [None req-346c91f5-a9b3-4471-bf04-fec9731eb55b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=92166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:21:20.530816 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: INFO nova.api.openstack.requestlog [None req-346c91f5-a9b3-4471-bf04-fec9731eb55b admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.010166 Jul 13 02:21:20.531329 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: [pid: 92166|app: 0|req: 24/47] 10.222.0.32 () {60 vars in 1191 bytes} [Tue Jul 13 02:21:20 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 13 02:21:21.890351 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi [None req-299b6401-2697-49ab-9abb-0ef31e913a72 admin admin] Calling method '>' {{(pid=92165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:21:21.891339 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: INFO nova.api.openstack.requestlog [None req-299b6401-2697-49ab-9abb-0ef31e913a72 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Jul 13 02:21:21.891729 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: [pid: 92165|app: 0|req: 24/48] 10.222.0.32 () {56 vars in 1075 bytes} [Tue Jul 13 02:21:21 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:21:22.086888 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi [None req-2103baee-3ef2-47e7-ba4b-e24d527fc937 admin admin] Calling method '>' {{(pid=92166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:21:22.092140 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: INFO nova.api.openstack.wsgi [None req-2103baee-3ef2-47e7-ba4b-e24d527fc937 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 13 02:21:22.092720 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi [None req-2103baee-3ef2-47e7-ba4b-e24d527fc937 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=92166) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:21:22.093518 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: INFO nova.api.openstack.requestlog [None req-2103baee-3ef2-47e7-ba4b-e24d527fc937 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.055158 Jul 13 02:21:22.094086 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: [pid: 92166|app: 0|req: 25/49] 10.222.0.32 () {60 vars in 1194 bytes} [Tue Jul 13 02:21:22 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 13 02:21:22.103166 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi [None req-c3d4adb3-60ef-499e-bbcd-2765c6b04bf3 admin admin] Calling method '>' {{(pid=92165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:21:22.117148 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: INFO nova.api.openstack.requestlog [None req-c3d4adb3-60ef-499e-bbcd-2765c6b04bf3 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017516 Jul 13 02:21:22.117667 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: [pid: 92165|app: 0|req: 25/50] 10.222.0.32 () {60 vars in 1211 bytes} [Tue Jul 13 02:21:22 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:21:22.127173 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi [None req-43892a6a-c1ea-4133-a743-486a3b06de52 admin admin] Calling method '>' {{(pid=92166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:21:22.141092 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: INFO nova.api.openstack.requestlog [None req-43892a6a-c1ea-4133-a743-486a3b06de52 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017734 Jul 13 02:21:22.141612 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: [pid: 92166|app: 0|req: 26/51] 10.222.0.32 () {60 vars in 1211 bytes} [Tue Jul 13 02:21:22 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:21:22.150630 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi [None req-831f60c5-a320-492e-8785-5a09763a7d3a admin admin] Calling method '>' {{(pid=92165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:21:22.155614 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: INFO nova.api.openstack.wsgi [None req-831f60c5-a320-492e-8785-5a09763a7d3a admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 13 02:21:22.156160 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi [None req-831f60c5-a320-492e-8785-5a09763a7d3a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=92165) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:21:22.156929 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: INFO nova.api.openstack.requestlog [None req-831f60c5-a320-492e-8785-5a09763a7d3a admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.009760 Jul 13 02:21:22.157410 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: [pid: 92165|app: 0|req: 26/52] 10.222.0.32 () {60 vars in 1194 bytes} [Tue Jul 13 02:21:22 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 13 02:21:23.509931 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi [None req-43892a6a-c1ea-4133-a743-486a3b06de52 admin admin] Calling method '>' {{(pid=92166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:21:23.510986 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: INFO nova.api.openstack.requestlog [None req-43892a6a-c1ea-4133-a743-486a3b06de52 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jul 13 02:21:23.511378 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: [pid: 92166|app: 0|req: 27/53] 10.222.0.32 () {56 vars in 1075 bytes} [Tue Jul 13 02:21:23 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:21:23.697066 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi [None req-46a53e84-2e34-4a88-aa4f-ee35b7c9e26f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=92165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:21:23.715209 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: INFO nova.api.openstack.requestlog [None req-46a53e84-2e34-4a88-aa4f-ee35b7c9e26f admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.066076 Jul 13 02:21:23.715745 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: [pid: 92165|app: 0|req: 27/54] 10.222.0.32 () {64 vars in 1236 bytes} [Tue Jul 13 02:21:23 2021] POST /compute/v2.1/flavors => generated 404 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 13 02:21:25.063902 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi [None req-43892a6a-c1ea-4133-a743-486a3b06de52 admin admin] Calling method '>' {{(pid=92166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:21:25.064884 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: INFO nova.api.openstack.requestlog [None req-43892a6a-c1ea-4133-a743-486a3b06de52 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001390 Jul 13 02:21:25.065272 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: [pid: 92166|app: 0|req: 28/55] 10.222.0.32 () {56 vars in 1075 bytes} [Tue Jul 13 02:21:25 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:21:25.251055 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi [None req-d20cac85-5440-4a82-a22d-5987db75e3f0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=92165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:21:25.270697 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: INFO nova.api.openstack.requestlog [None req-d20cac85-5440-4a82-a22d-5987db75e3f0 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.067272 Jul 13 02:21:25.271159 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: [pid: 92165|app: 0|req: 28/56] 10.222.0.32 () {64 vars in 1236 bytes} [Tue Jul 13 02:21:25 2021] POST /compute/v2.1/flavors => generated 405 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 13 02:21:26.595303 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi [None req-43892a6a-c1ea-4133-a743-486a3b06de52 admin admin] Calling method '>' {{(pid=92166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:21:26.596319 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: INFO nova.api.openstack.requestlog [None req-43892a6a-c1ea-4133-a743-486a3b06de52 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jul 13 02:21:26.596718 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: [pid: 92166|app: 0|req: 29/57] 10.222.0.32 () {56 vars in 1075 bytes} [Tue Jul 13 02:21:26 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:21:26.784738 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi [None req-7bf1dec6-eb08-4246-9e0b-df04abca5cf0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=92165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:21:26.802308 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: INFO nova.api.openstack.requestlog [None req-7bf1dec6-eb08-4246-9e0b-df04abca5cf0 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.066644 Jul 13 02:21:26.802848 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: [pid: 92165|app: 0|req: 29/58] 10.222.0.32 () {64 vars in 1236 bytes} [Tue Jul 13 02:21:26 2021] POST /compute/v2.1/flavors => generated 407 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:21:28.144840 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi [None req-43892a6a-c1ea-4133-a743-486a3b06de52 admin admin] Calling method '>' {{(pid=92166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:21:28.145837 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: INFO nova.api.openstack.requestlog [None req-43892a6a-c1ea-4133-a743-486a3b06de52 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001768 Jul 13 02:21:28.146288 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: [pid: 92166|app: 0|req: 30/59] 10.222.0.32 () {56 vars in 1075 bytes} [Tue Jul 13 02:21:28 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:21:28.331869 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi [None req-cde9ed6d-6b5d-49eb-8d18-dc6782e04b31 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=92165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:21:28.349710 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: INFO nova.api.openstack.requestlog [None req-cde9ed6d-6b5d-49eb-8d18-dc6782e04b31 admin admin] 10.222.0.32 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.066195 Jul 13 02:21:28.350297 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: [pid: 92165|app: 0|req: 30/60] 10.222.0.32 () {64 vars in 1236 bytes} [Tue Jul 13 02:21:28 2021] POST /compute/v2.1/flavors => generated 409 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 13 02:21:29.684737 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi [None req-43892a6a-c1ea-4133-a743-486a3b06de52 admin admin] Calling method '>' {{(pid=92166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:21:29.685787 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: INFO nova.api.openstack.requestlog [None req-43892a6a-c1ea-4133-a743-486a3b06de52 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Jul 13 02:21:29.686220 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: [pid: 92166|app: 0|req: 31/61] 10.222.0.32 () {56 vars in 1075 bytes} [Tue Jul 13 02:21:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:21:29.872843 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi [None req-d9313496-a0f6-4460-a6a6-7b7ec5cfa6b2 admin admin] Calling method '>' {{(pid=92165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:21:29.892630 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: INFO nova.api.openstack.requestlog [None req-d9313496-a0f6-4460-a6a6-7b7ec5cfa6b2 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.066965 Jul 13 02:21:29.893147 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: [pid: 92165|app: 0|req: 31/62] 10.222.0.32 () {60 vars in 1203 bytes} [Tue Jul 13 02:21:29 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:22:14.707701 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi [None req-43892a6a-c1ea-4133-a743-486a3b06de52 admin admin] Calling method '>' {{(pid=92166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:22:14.708688 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: INFO nova.api.openstack.requestlog [None req-43892a6a-c1ea-4133-a743-486a3b06de52 admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001394 Jul 13 02:22:14.709088 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: [pid: 92166|app: 0|req: 32/63] 10.222.0.32 () {54 vars in 931 bytes} [Tue Jul 13 02:22:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:22:14.763467 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi [None req-4e8b4d21-ca1a-47a3-aa2e-273e5ce2a018 admin admin] Calling method '>' {{(pid=92165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:22:14.783319 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: INFO nova.api.openstack.requestlog [None req-4e8b4d21-ca1a-47a3-aa2e-273e5ce2a018 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.068453 Jul 13 02:22:14.783888 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: [pid: 92165|app: 0|req: 32/64] 10.222.0.32 () {60 vars in 1292 bytes} [Tue Jul 13 02:22:14 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:22:14.805196 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi [None req-e6e74fc0-e9e1-491c-b691-5afb88064058 admin admin] Calling method '>' {{(pid=92166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:22:14.812972 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: INFO nova.api.openstack.requestlog [None req-e6e74fc0-e9e1-491c-b691-5afb88064058 admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011372 Jul 13 02:22:14.813481 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: [pid: 92166|app: 0|req: 33/65] 10.222.0.32 () {60 vars in 1283 bytes} [Tue Jul 13 02:22:14 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:22:14.824729 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi [None req-f077e9f8-76a0-4167-890a-086557f3aa6d admin admin] Calling method '>' {{(pid=92165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:22:14.832785 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: INFO nova.api.openstack.requestlog [None req-f077e9f8-76a0-4167-890a-086557f3aa6d admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011492 Jul 13 02:22:14.833291 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: [pid: 92165|app: 0|req: 33/66] 10.222.0.32 () {60 vars in 1286 bytes} [Tue Jul 13 02:22:14 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:22:14.843747 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi [None req-a055a676-7f58-460b-9602-5db210a5cd7e admin admin] Calling method '>' {{(pid=92166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:22:14.851134 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: INFO nova.api.openstack.requestlog [None req-a055a676-7f58-460b-9602-5db210a5cd7e admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010740 Jul 13 02:22:14.851653 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: [pid: 92166|app: 0|req: 34/67] 10.222.0.32 () {60 vars in 1286 bytes} [Tue Jul 13 02:22:14 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:22:14.861896 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi [None req-6b085509-9d7b-484f-801a-22f849cd0fef admin admin] Calling method '>' {{(pid=92165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:22:14.869131 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: INFO nova.api.openstack.requestlog [None req-6b085509-9d7b-484f-801a-22f849cd0fef admin admin] 10.222.0.32 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010551 Jul 13 02:22:14.869640 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: [pid: 92165|app: 0|req: 34/68] 10.222.0.32 () {60 vars in 1283 bytes} [Tue Jul 13 02:22:14 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:23:33.667309 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi [None req-297ddab4-365d-41f8-a9b9-b71e5e404bca tempest-verify_tempest_config-1604196289 tempest-verify_tempest_config-1604196289-project] Calling method '>' {{(pid=92166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:23:33.669263 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: INFO nova.api.openstack.requestlog [None req-297ddab4-365d-41f8-a9b9-b71e5e404bca tempest-verify_tempest_config-1604196289 tempest-verify_tempest_config-1604196289-project] 10.222.0.32 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.102588 Jul 13 02:23:33.669793 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: [pid: 92166|app: 0|req: 35/69] 10.222.0.32 () {58 vars in 1134 bytes} [Tue Jul 13 02:23:33 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:25:01.177650 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi [None req-6b085509-9d7b-484f-801a-22f849cd0fef admin admin] Calling method '>' {{(pid=92165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:25:01.178766 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: INFO nova.api.openstack.requestlog [None req-6b085509-9d7b-484f-801a-22f849cd0fef admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002077 Jul 13 02:25:01.179156 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: [pid: 92165|app: 0|req: 35/70] 10.222.0.32 () {56 vars in 1075 bytes} [Tue Jul 13 02:25:01 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:25:01.429843 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi [None req-d49cc067-e31f-4bb8-ba4c-f13f28b4ea09 admin admin] Calling method '>' {{(pid=92166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:25:01.431000 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:25:01.431000 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: warnings.warn(msg) Jul 13 02:25:01.432498 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG oslo_concurrency.lockutils [None req-d49cc067-e31f-4bb8-ba4c-f13f28b4ea09 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:25:01.432950 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG oslo_concurrency.lockutils [None req-d49cc067-e31f-4bb8-ba4c-f13f28b4ea09 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:25:01.433719 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG oslo_concurrency.lockutils [None req-d49cc067-e31f-4bb8-ba4c-f13f28b4ea09 admin admin] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:25:01.434179 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG oslo_concurrency.lockutils [None req-d49cc067-e31f-4bb8-ba4c-f13f28b4ea09 admin admin] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:25:01.437747 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: /opt/stack/nova/nova/db/sqlalchemy/api.py:450: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:25:01.437747 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: return query.all() Jul 13 02:25:01.466802 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: INFO nova.api.openstack.requestlog [None req-d49cc067-e31f-4bb8-ba4c-f13f28b4ea09 admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.146595 Jul 13 02:25:01.467351 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: [pid: 92166|app: 0|req: 36/71] 10.222.0.32 () {60 vars in 1194 bytes} [Tue Jul 13 02:25:01 2021] GET /compute/v2.1/os-services => generated 791 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:25:02.824024 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi [None req-6b085509-9d7b-484f-801a-22f849cd0fef admin admin] Calling method '>' {{(pid=92165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:25:02.825009 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: INFO nova.api.openstack.requestlog [None req-6b085509-9d7b-484f-801a-22f849cd0fef admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Jul 13 02:25:02.825406 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: [pid: 92165|app: 0|req: 36/72] 10.222.0.32 () {56 vars in 1075 bytes} [Tue Jul 13 02:25:02 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:25:03.019558 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi [None req-17ea7588-d38e-4f60-b6d5-ee8e6e188c51 admin admin] Calling method '>' {{(pid=92166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:25:03.021216 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:25:03.021216 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: warnings.warn(msg) Jul 13 02:25:03.023389 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG oslo_concurrency.lockutils [None req-17ea7588-d38e-4f60-b6d5-ee8e6e188c51 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:25:03.023818 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG oslo_concurrency.lockutils [None req-17ea7588-d38e-4f60-b6d5-ee8e6e188c51 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:25:03.024584 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG oslo_concurrency.lockutils [None req-17ea7588-d38e-4f60-b6d5-ee8e6e188c51 admin admin] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:25:03.024999 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG oslo_concurrency.lockutils [None req-17ea7588-d38e-4f60-b6d5-ee8e6e188c51 admin admin] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:25:03.028165 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: /opt/stack/nova/nova/db/sqlalchemy/api.py:450: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:25:03.028165 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: return query.all() Jul 13 02:25:03.048258 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: INFO nova.api.openstack.requestlog [None req-17ea7588-d38e-4f60-b6d5-ee8e6e188c51 admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.079731 Jul 13 02:25:03.048732 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: [pid: 92166|app: 0|req: 37/73] 10.222.0.32 () {60 vars in 1194 bytes} [Tue Jul 13 02:25:02 2021] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:25:14.801062 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi [None req-6b085509-9d7b-484f-801a-22f849cd0fef admin admin] Calling method '>' {{(pid=92165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:25:14.802172 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: INFO nova.api.openstack.requestlog [None req-6b085509-9d7b-484f-801a-22f849cd0fef admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jul 13 02:25:14.802709 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: [pid: 92165|app: 0|req: 37/74] 10.222.0.32 () {56 vars in 1075 bytes} [Tue Jul 13 02:25:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:25:14.993155 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi [None req-d5bdc0ee-9d87-4a38-a5a7-ac22ad00f4ad admin admin] Calling method '>' {{(pid=92166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:25:14.994342 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:25:14.994342 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: warnings.warn(msg) Jul 13 02:25:14.995858 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG oslo_concurrency.lockutils [None req-d5bdc0ee-9d87-4a38-a5a7-ac22ad00f4ad admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:25:14.996590 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG oslo_concurrency.lockutils [None req-d5bdc0ee-9d87-4a38-a5a7-ac22ad00f4ad admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:25:14.997368 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG oslo_concurrency.lockutils [None req-d5bdc0ee-9d87-4a38-a5a7-ac22ad00f4ad admin admin] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:25:14.997787 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG oslo_concurrency.lockutils [None req-d5bdc0ee-9d87-4a38-a5a7-ac22ad00f4ad admin admin] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:25:15.000984 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: /opt/stack/nova/nova/db/sqlalchemy/api.py:450: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:25:15.000984 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: return query.all() Jul 13 02:25:15.026351 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: INFO nova.api.openstack.requestlog [None req-d5bdc0ee-9d87-4a38-a5a7-ac22ad00f4ad admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.88 time: 0.082465 Jul 13 02:25:15.026923 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: [pid: 92166|app: 0|req: 38/75] 10.222.0.32 () {60 vars in 1194 bytes} [Tue Jul 13 02:25:14 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:25:16.366997 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: DEBUG nova.api.openstack.wsgi [None req-6b085509-9d7b-484f-801a-22f849cd0fef admin admin] Calling method '>' {{(pid=92165) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:25:16.368150 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: INFO nova.api.openstack.requestlog [None req-6b085509-9d7b-484f-801a-22f849cd0fef admin admin] 10.222.0.32 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Jul 13 02:25:16.368653 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: [pid: 92165|app: 0|req: 38/76] 10.222.0.32 () {56 vars in 1075 bytes} [Tue Jul 13 02:25:16 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:25:16.559009 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG nova.api.openstack.wsgi [None req-f44cb82c-6145-41f2-a4ba-232af4b7df8a admin admin] Calling method '>' {{(pid=92166) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:25:16.560156 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:25:16.560156 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: warnings.warn(msg) Jul 13 02:25:16.561684 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG oslo_concurrency.lockutils [None req-f44cb82c-6145-41f2-a4ba-232af4b7df8a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:25:16.562148 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG oslo_concurrency.lockutils [None req-f44cb82c-6145-41f2-a4ba-232af4b7df8a admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:25:16.563011 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG oslo_concurrency.lockutils [None req-f44cb82c-6145-41f2-a4ba-232af4b7df8a admin admin] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=92166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:25:16.563432 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: DEBUG oslo_concurrency.lockutils [None req-f44cb82c-6145-41f2-a4ba-232af4b7df8a admin admin] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=92166) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:25:16.566648 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: /opt/stack/nova/nova/db/sqlalchemy/api.py:450: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:25:16.566648 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: return query.all() Jul 13 02:25:16.587642 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: INFO nova.api.openstack.requestlog [None req-f44cb82c-6145-41f2-a4ba-232af4b7df8a admin admin] 10.222.0.32 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.88 time: 0.077671 Jul 13 02:25:16.588118 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: [pid: 92166|app: 0|req: 39/77] 10.222.0.32 () {60 vars in 1194 bytes} [Tue Jul 13 02:25:16 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:26:13.138276 dv-cinder-781024-2-iscsi devstack@n-api.service[92164]: Tue Jul 13 02:26:13 2021 - graceful shutdown triggered... Jul 13 02:26:13.138780 dv-cinder-781024-2-iscsi devstack@n-api.service[92165]: Gracefully killing worker 1 (pid: 92165)... Jul 13 02:26:13.139193 dv-cinder-781024-2-iscsi devstack@n-api.service[92166]: Gracefully killing worker 2 (pid: 92166)... Jul 13 02:26:13.140201 dv-cinder-781024-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 13 02:26:14.139473 dv-cinder-781024-2-iscsi devstack@n-api.service[92164]: worker 1 buried after 1 seconds Jul 13 02:26:14.139473 dv-cinder-781024-2-iscsi devstack@n-api.service[92164]: worker 2 buried after 1 seconds Jul 13 02:26:14.139473 dv-cinder-781024-2-iscsi devstack@n-api.service[92164]: goodbye to uWSGI. Jul 13 02:26:14.140992 dv-cinder-781024-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 13 02:26:14.141534 dv-cinder-781024-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 13 02:26:14.144348 dv-cinder-781024-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 13 02:26:14.155240 dv-cinder-781024-2-iscsi devstack@n-api.service[107250]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 13 02:26:14.158067 dv-cinder-781024-2-iscsi devstack@n-api.service[107250]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 13 02:26:14 2021] *** Jul 13 02:26:14.158067 dv-cinder-781024-2-iscsi devstack@n-api.service[107250]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 13 02:26:14.158067 dv-cinder-781024-2-iscsi devstack@n-api.service[107250]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 13 02:26:14.158067 dv-cinder-781024-2-iscsi devstack@n-api.service[107250]: nodename: dv-cinder-781024-2-iscsi Jul 13 02:26:14.158067 dv-cinder-781024-2-iscsi devstack@n-api.service[107250]: machine: x86_64 Jul 13 02:26:14.158067 dv-cinder-781024-2-iscsi devstack@n-api.service[107250]: clock source: unix Jul 13 02:26:14.158067 dv-cinder-781024-2-iscsi devstack@n-api.service[107250]: pcre jit disabled Jul 13 02:26:14.158067 dv-cinder-781024-2-iscsi devstack@n-api.service[107250]: detected number of CPU cores: 4 Jul 13 02:26:14.158067 dv-cinder-781024-2-iscsi devstack@n-api.service[107250]: current working directory: / Jul 13 02:26:14.158067 dv-cinder-781024-2-iscsi devstack@n-api.service[107250]: detected binary path: /usr/bin/uwsgi-core Jul 13 02:26:14.158067 dv-cinder-781024-2-iscsi devstack@n-api.service[107250]: your processes number limit is 47680 Jul 13 02:26:14.158067 dv-cinder-781024-2-iscsi devstack@n-api.service[107250]: your memory page size is 4096 bytes Jul 13 02:26:14.158067 dv-cinder-781024-2-iscsi devstack@n-api.service[107250]: detected max file descriptor number: 2048 Jul 13 02:26:14.158067 dv-cinder-781024-2-iscsi devstack@n-api.service[107250]: lock engine: pthread robust mutexes Jul 13 02:26:14.158067 dv-cinder-781024-2-iscsi devstack@n-api.service[107250]: thunder lock: enabled Jul 13 02:26:14.158067 dv-cinder-781024-2-iscsi devstack@n-api.service[107250]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 13 02:26:14.158067 dv-cinder-781024-2-iscsi devstack@n-api.service[107250]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Jul 13 02:26:14.203076 dv-cinder-781024-2-iscsi devstack@n-api.service[107250]: Python main interpreter initialized at 0x558b518659c0 Jul 13 02:26:14.203076 dv-cinder-781024-2-iscsi devstack@n-api.service[107250]: python threads support enabled Jul 13 02:26:14.203076 dv-cinder-781024-2-iscsi devstack@n-api.service[107250]: your server socket listen backlog is limited to 100 connections Jul 13 02:26:14.203076 dv-cinder-781024-2-iscsi devstack@n-api.service[107250]: your mercy for graceful operations on workers is 90 seconds Jul 13 02:26:14.203565 dv-cinder-781024-2-iscsi devstack@n-api.service[107250]: mapped 403077 bytes (393 KB) for 2 cores Jul 13 02:26:14.203565 dv-cinder-781024-2-iscsi devstack@n-api.service[107250]: *** Operational MODE: preforking *** Jul 13 02:26:14.203814 dv-cinder-781024-2-iscsi devstack@n-api.service[107250]: *** uWSGI is running in multiple interpreter mode *** Jul 13 02:26:14.203814 dv-cinder-781024-2-iscsi devstack@n-api.service[107250]: spawned uWSGI master process (pid: 107250) Jul 13 02:26:14.204015 dv-cinder-781024-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 13 02:26:14.204733 dv-cinder-781024-2-iscsi devstack@n-api.service[107250]: spawned uWSGI worker 1 (pid: 107262, cores: 1) Jul 13 02:26:14.206062 dv-cinder-781024-2-iscsi devstack@n-api.service[107250]: spawned uWSGI worker 2 (pid: 107263, cores: 1) Jul 13 02:26:14.206062 dv-cinder-781024-2-iscsi devstack@n-api.service[107250]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 13 02:26:16.013373 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 02:26:16.013373 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: from cryptography.utils import int_from_bytes Jul 13 02:26:16.013373 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 02:26:16.013373 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: from cryptography.utils import int_from_bytes Jul 13 02:26:16.026156 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 02:26:16.026156 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: from cryptography.utils import int_from_bytes Jul 13 02:26:16.026766 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 13 02:26:16.026766 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: from cryptography.utils import int_from_bytes Jul 13 02:26:18.542632 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 13 02:26:18.543210 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 13 02:26:18.543314 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 13 02:26:18.543631 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 13 02:26:18.543890 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 13 02:26:18.544283 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.544618 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.544949 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.545284 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.545621 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.545939 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.546287 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.546613 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.546947 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.547214 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.547536 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.547866 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-781024-2-iscsi {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.548189 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.548387 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 13 02:26:18.548803 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.548910 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 13 02:26:18.549002 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.549099 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 13 02:26:18.549210 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.549402 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.549517 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 13 02:26:18.549704 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 13 02:26:18.549801 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.550043 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.550155 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.550439 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.550540 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.550772 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.550989 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.551093 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.551301 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.551410 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.551618 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.551723 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.552021 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.552128 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.552263 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.552378 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.552575 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.552668 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.552899 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.552994 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.553212 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.553330 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.553537 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-781024-2-iscsi {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.553636 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.553848 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.553944 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.554187 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.554296 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-781024-2-iscsi {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.554506 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.554596 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.554830 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.554936 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.555141 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.555339 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.555547 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.555654 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.555793 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.555955 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.556232 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.556334 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.556638 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.556738 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.556870 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.556973 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.557181 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.557336 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.557513 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.557622 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.557830 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.557930 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.558171 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.558280 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.558494 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.558591 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.558802 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.558906 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.559117 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.559253 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.559429 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.559563 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.559751 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.559893 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-781024-2-iscsi {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.560061 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.560163 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.560368 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.560471 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.560621 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.560719 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.560933 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.561136 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.561261 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.561456 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.561586 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.561773 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.561911 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.562122 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.562237 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.562445 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.562556 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.562754 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.562845 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.563086 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.563187 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.563400 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.563500 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.563713 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.563803 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.564026 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.564124 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.564331 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.564428 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.564641 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.564730 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.564951 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.565044 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.565264 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.565354 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.565573 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.565668 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.565881 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.565982 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.566161 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.566265 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.566488 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.566588 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.566816 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.566913 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.567148 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.567246 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.567476 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.567592 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.567738 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.567884 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.567978 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.568098 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.568305 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.568450 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.568640 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.568743 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.568956 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.569054 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.569271 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.569369 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.569586 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.569683 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.569899 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.569999 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.570238 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.570383 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.570553 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.570651 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.570867 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.570965 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.571179 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.571282 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.572048 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.572221 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.572316 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.572418 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.572558 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.572838 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.572934 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.573157 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.573248 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.573471 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.573570 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.573784 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.573882 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.32 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.574121 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.574218 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.32 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.574426 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.574525 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.574736 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.574835 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.575048 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.575148 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.575359 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.575456 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.575675 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.575766 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.575985 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.576084 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.576294 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.576392 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.576606 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.576707 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.576915 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.577018 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.577224 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.577321 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.577544 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.577645 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.577862 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.577992 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.578144 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.578260 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.578453 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.578598 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.578766 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.578872 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.579090 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.579196 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.579405 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.579509 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.579712 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.579803 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.580025 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.580126 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.580329 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.580419 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.580644 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.580746 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.580949 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.581056 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.581259 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.581348 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.581569 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.581658 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.581881 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.581979 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.582216 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.582321 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.582519 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.582617 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.582830 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.582933 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.583139 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.583241 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.583448 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.583537 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.583758 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.583858 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.584064 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.584162 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.584371 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.584474 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.584679 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.584776 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.584986 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.585086 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.585293 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.585393 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.585604 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.585693 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.585904 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.586006 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.586250 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.586452 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.586545 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.586689 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.586855 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.586955 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.587227 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.587353 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.587607 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.587723 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.587881 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.588032 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.588182 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.588275 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.588517 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.588656 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.588861 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.588964 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.589180 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.589280 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.589491 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.589590 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.589803 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.589893 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.590141 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.590248 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.590456 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.590562 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.590764 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.590940 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.591074 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.591167 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.591383 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.591475 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.591691 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.591789 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.591994 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.592085 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.592316 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.592415 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.592638 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.592735 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.592949 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.593039 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.593263 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.593361 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.593574 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.593673 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.593897 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.593993 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 13 02:26:18.594239 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.594340 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.594563 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.594665 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.594893 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.594997 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.595217 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.595307 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.595537 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.595638 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.595875 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.595973 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.596200 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.596300 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.596518 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.596610 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.596845 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.596934 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.597162 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.597266 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.597484 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.597580 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.597801 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.597898 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.598138 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.598251 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.598457 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.598554 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.598777 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.598874 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.599094 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.599190 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.599412 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.599512 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.599731 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.599835 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.600057 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.600152 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.600375 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.600464 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.600685 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.600835 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.600994 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.601086 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.601303 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.601401 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.601618 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.601718 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.601926 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.602049 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.602273 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.602364 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.603105 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.603220 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.603435 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.603537 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.603749 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.603933 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.604045 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.604274 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.604364 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.604598 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.604689 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.604923 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.605032 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.605247 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.605340 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.605572 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.605669 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.605881 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.605986 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.606227 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.606318 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.606543 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.606640 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.606854 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.606964 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.607184 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.607276 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.607493 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.607582 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.607800 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.607890 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.608114 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.608243 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.608428 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.608527 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.608737 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.608862 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.609052 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.609150 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.609382 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.609474 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.609691 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.609781 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.610005 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.610151 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.610352 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.610498 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.610670 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.610771 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.610985 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.611079 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.611290 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.611497 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.611599 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.611691 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.611915 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.612008 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.612226 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.612331 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.612540 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.612630 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.612848 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.612939 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.613157 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.613260 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.613465 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.613556 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.613780 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.613879 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.614112 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.614222 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.614424 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.614524 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.614733 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.614824 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.615041 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.615132 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.615355 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.615445 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.615681 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.615779 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.615996 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.616087 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.616304 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.616402 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.616611 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.616708 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.616917 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.617015 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.617260 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.617356 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.617567 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.617665 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.617905 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.618003 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.618272 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.618889 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.619112 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.619217 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.619511 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.619612 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.619823 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.619915 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.620138 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.620240 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.620449 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.620592 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.620768 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.620859 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.621079 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.621183 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.621392 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.621526 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.621702 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.621802 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.622011 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.622172 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.622349 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.622447 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.622675 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.622773 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.622990 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.623093 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.623301 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.623392 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.623608 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.623701 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.623917 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.624008 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.624237 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.624337 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.624551 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.624708 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.624868 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.624971 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.625180 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.625278 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.625495 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.625586 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.625810 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.625909 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.626156 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.626250 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.626472 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.626561 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.626782 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.626880 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.627089 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.627190 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.627410 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.627513 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.627719 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.627815 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.628024 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.628121 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.628332 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.628436 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.628645 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.628738 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.628968 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.629066 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.629285 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.629389 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.629606 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.629698 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.629926 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.630066 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.630258 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.630366 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.630567 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.630715 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.630880 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.630970 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.631193 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.631287 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.631501 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.631642 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.631809 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.631901 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.632115 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.632208 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.632435 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.632524 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.632754 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.632853 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.633062 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.633159 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.633371 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.633461 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.633697 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.633797 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.634115 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.634222 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.634556 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.634645 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.634882 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.634990 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.635199 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.635298 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.635530 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.635620 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.635846 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.635944 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.636160 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.636259 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.636477 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.636569 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.636787 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.636885 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.637354 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.637453 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.637676 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.637776 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.638004 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.638171 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.638341 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.638445 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.638650 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.638748 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.638960 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.639060 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.639265 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.639355 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.639582 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.639727 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.639903 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.639996 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.640225 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.640488 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.640594 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.640829 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.640933 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.641152 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.641251 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.641467 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.641563 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.641782 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.641952 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.642130 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.642234 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.642449 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.642546 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.642767 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.642866 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.643084 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.643176 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.643391 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.643480 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.643704 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.643796 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.644013 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.644115 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.644322 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.644420 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.644637 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.644729 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.644945 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.645043 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.645253 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.645344 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.645559 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.645649 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.645871 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.645961 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.646212 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.646318 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.646522 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.646798 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.646889 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.647122 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.647219 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.647441 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.647540 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.647749 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.647848 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.648066 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.648157 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.648372 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.648470 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.648699 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.648798 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.649011 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.649102 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.649319 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.649447 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.650163 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.650298 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.650474 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.650627 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.650795 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.650937 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.651104 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.651197 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.651424 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.651529 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.651738 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.651838 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.652049 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.652141 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.652359 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.652463 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.652678 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.652776 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.652988 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.653087 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.653296 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.653395 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.653603 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.653693 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.653906 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.654060 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.654244 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.654340 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.654553 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.654642 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.654858 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.654955 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.655167 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.655258 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.655489 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.655579 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.655806 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.655896 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.656114 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.656203 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.656421 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.656519 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.656727 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.656817 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.657046 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.657138 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.657355 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.657455 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.657662 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.657761 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.657968 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.658078 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.658309 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.658419 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.658623 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.658720 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.658930 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.659032 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.659256 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.659361 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.659573 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.659671 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.659880 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.659978 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.660188 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.660281 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.660491 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.660582 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.660796 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.660894 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.661104 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.661197 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.661427 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.661517 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.661742 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.661839 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.662082 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.662177 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.662382 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.662487 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.662690 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.662789 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.662998 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.663094 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.663303 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.663402 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.663617 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.663714 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.663920 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.664016 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.664225 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.664333 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.664530 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.664621 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.664837 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.664935 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.665195 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.665797 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.666016 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.666139 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.666359 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.666452 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.666668 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.666769 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.666983 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.667074 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.667293 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.667391 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.667601 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.667700 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.667917 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.668009 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.668252 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.668343 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.668573 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.668673 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.668882 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.668973 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.669197 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.669302 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.669508 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.669641 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.669820 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.669922 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.670161 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.670273 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.670473 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.670576 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.670781 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.670871 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.671091 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.671190 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.671401 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.671536 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.671707 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.671801 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.672001 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.672103 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.672326 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.672417 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.672643 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.672769 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.672953 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.673055 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.673264 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.673363 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.673573 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.673672 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.673901 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.674000 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.674236 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.674337 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.674551 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.674642 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.674869 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.674967 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.675183 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.675281 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.675496 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.675587 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.675818 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.675909 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.676135 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.676225 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.676450 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.676547 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.676759 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.676924 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.677075 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.677173 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.677393 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.677490 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.677704 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.677800 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.678012 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.678157 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.678351 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.678456 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.678662 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.678753 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.678994 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.679085 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.679311 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.679420 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.679620 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.679747 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.679934 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.680026 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.680244 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.680345 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.680563 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.680653 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.680929 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.681027 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.681620 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.681724 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.681798 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.681866 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.681935 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.682010 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.682264 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.682359 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.682587 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.682680 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.682913 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.683011 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.683241 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.683372 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.683562 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.683651 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.683870 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.683963 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.684185 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.684275 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.684506 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.684597 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.684825 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.684916 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.685140 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.685240 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.685474 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.685574 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.685795 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.685896 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.686134 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.686257 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.686454 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.686591 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.686767 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.686902 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.687087 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.687214 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.687403 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.687570 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.687840 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.687940 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.688151 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.688243 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.688475 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.688572 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.688791 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.688892 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.689112 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.689210 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.689433 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.689524 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.689761 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.689900 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.690115 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.690209 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.690431 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.690522 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.690844 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.690938 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.691166 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.691267 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.691487 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.691578 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.691796 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.691886 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.692106 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.692196 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.692418 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.692553 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.692736 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.692836 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.693061 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.693162 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.693369 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.693472 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.693681 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.693772 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.693987 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.694119 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.694340 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.694446 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.694650 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.694744 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.694974 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.695071 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.695302 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.695402 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.695703 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.695792 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.696013 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.696105 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.696356 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.696522 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.696694 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.696803 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.697021 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.697112 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.697330 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.697422 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.697639 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.697737 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.697954 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.698074 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.698293 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.698470 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.698605 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.698704 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.698932 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.699033 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.699240 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.699400 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.699558 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.699658 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.699875 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.700003 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.700189 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.700289 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.700495 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.700587 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.700801 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.700902 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.701128 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.701227 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.701437 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.701580 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.701764 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.701898 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.702103 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.702197 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.702417 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.702510 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.702743 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.702848 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.703052 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.703143 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.703377 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.703468 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.703692 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.703795 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.703999 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.704097 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.704307 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.704398 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.704613 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.704749 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.704946 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.705037 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.705252 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.705341 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.705576 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.705674 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.705896 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.705988 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.706239 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.706332 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.706556 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.706649 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.706866 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.706958 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.707176 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.707276 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.707505 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.707596 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.707815 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.707907 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.708143 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.708250 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.708455 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.708547 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.708763 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.708853 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.709078 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.709177 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.709388 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.709488 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.709699 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.709791 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.710006 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.710170 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.710345 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.710444 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.710653 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.710752 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.710959 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.711093 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.711266 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.711388 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.711591 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.711695 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.711900 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.712534 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.712769 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.712863 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.713111 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.713246 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.713423 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.713522 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.713760 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.713861 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.714093 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.714188 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.714439 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.714548 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.714747 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.714882 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.715084 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.715176 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.715396 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.715497 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.715708 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.715807 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.716026 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.716126 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.716336 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.716427 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.716648 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.716784 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.716985 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.717083 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.717299 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.717397 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.717608 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.717713 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.717917 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.718009 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.718250 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.718351 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.718577 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.718675 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.718885 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.718975 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.719202 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.719291 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.719515 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.719618 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.719827 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.719918 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.720138 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.720276 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.720447 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.720676 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.720796 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.721011 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.721103 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.721333 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.721510 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.721652 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.721743 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.721970 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.722125 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.722333 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.722445 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.722653 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.722744 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.722971 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.723071 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.723288 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.723393 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.723605 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.723704 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.723922 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.724015 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.724256 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.724357 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.724576 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.724666 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.724898 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.725039 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.725243 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.725343 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.725567 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.725771 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.725890 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.726130 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.726241 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.726460 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.726551 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.726785 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.726917 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.727244 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.727335 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.727555 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.728218 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.728437 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.728537 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.728765 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.728858 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.729090 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.729189 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.729413 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.729505 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.729737 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.729834 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.730078 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.730171 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.730401 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.730509 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.730722 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.730815 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.731038 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.731129 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.731357 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.731499 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.731678 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.731771 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.732014 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.732104 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.732354 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.732453 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.732678 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.732774 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.732995 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.733085 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.733313 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.733405 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.733633 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.733731 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.733999 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.734181 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.734349 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.734503 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.734665 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.734839 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.734995 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.735170 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.735323 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.735501 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.735648 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.735826 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.735975 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.736153 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.736298 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.736486 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.736618 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.736798 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.736945 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.737108 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.737268 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.737426 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.737584 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.737741 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.737902 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.738069 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.738261 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.738402 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.738596 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.738719 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.738945 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.739063 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.739276 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.739417 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.739593 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.739685 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.739911 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.740162 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.740263 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.740516 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.740745 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.740836 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.741066 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.741204 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.741403 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.741538 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.741732 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.741837 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.742085 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.742182 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.742411 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.742502 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.742730 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.742837 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.743044 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.743139 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.743412 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.743508 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.743728 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.743832 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.744047 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.744138 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.744365 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.744456 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.744675 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.744775 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.744991 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.745089 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.745303 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.745398 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.745610 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.745710 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.745916 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.746014 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.746264 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.746355 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.746583 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.746803 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.746894 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.747155 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.747246 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.747479 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.747592 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.747798 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.747888 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.748111 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.748202 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.748424 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.748524 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.748735 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.748827 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.749054 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.749154 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.749363 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.749468 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.749672 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.749811 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.749980 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.750090 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.750322 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.750414 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.750629 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.750719 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.750936 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.751033 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.751242 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.751339 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.751557 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.751684 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.751868 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.751960 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.752176 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.752309 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.752484 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.752576 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.752804 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.752909 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.753119 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.753213 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.753431 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.753524 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.753741 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.753847 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.754077 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.754186 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.754389 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.754488 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.754701 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.754962 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.755055 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.755305 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.755397 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.755623 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.755721 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.755934 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.756034 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.756250 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.756348 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.756559 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.756733 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.756877 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.756969 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.757187 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.757278 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.757503 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.757620 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.757816 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.757913 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.758161 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.758255 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.758479 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.758590 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.758788 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.758930 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.759141 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.759237 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.759456 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.759606 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.759775 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.759875 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.760092 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.760183 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.760406 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.760497 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.760723 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.760819 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.761067 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.761250 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.761579 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.761677 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.761908 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.762001 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.762510 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.762655 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.762838 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.762932 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.763156 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.763248 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.763472 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.763577 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.763787 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.763880 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.764101 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.764199 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.764424 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.764593 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.764741 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.764831 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.765060 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.765151 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.765368 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.765506 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.765684 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.765776 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.766003 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.766152 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.766341 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.766444 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.766661 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.766762 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.766979 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.767079 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.767297 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.767390 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.767615 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.767715 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.768082 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.768177 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.768414 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.768514 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.768729 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.768822 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.769040 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.769139 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.769351 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.769490 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.769667 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.769759 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.770015 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.770142 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.770381 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.770482 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.770696 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.770823 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.771023 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.771124 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.771358 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.771449 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.771678 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.771776 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.771990 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.772091 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.772307 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.772406 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.772625 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.772766 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.772944 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.773047 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.773272 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.773371 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.773592 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.773687 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.773918 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.774011 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.774260 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.774364 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.775131 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.775241 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.775448 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.775541 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.775822 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.775920 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.776137 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.776228 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.776452 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.776559 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.776772 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.776866 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.777095 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.777185 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.777435 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.777536 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.777757 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.777850 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.778111 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.778217 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.778432 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.778531 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.778759 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.778852 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.779077 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.779180 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.779396 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.779487 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.779717 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.779865 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.780036 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.780142 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.780353 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.780454 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.780671 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.780769 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.780993 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.781098 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.781308 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.781406 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.781622 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.781721 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.781936 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.782106 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.782287 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.782378 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.782600 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.782693 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.782924 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.783024 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.783243 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.783375 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.783566 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] database.use_tpool = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.783676 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.783907 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.784001 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.784231 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.784330 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.784556 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.784656 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.784872 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.784964 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.785191 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.785289 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.785507 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.785607 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.785834 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.785932 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.786181 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.786277 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.786504 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.786609 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.786823 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.786965 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.787147 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.787241 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.787463 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.787564 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.787782 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.787883 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.788101 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.788193 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.788420 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.788522 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.788742 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.788841 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.789060 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.789155 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.789394 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.789489 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.789727 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.789818 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.790065 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.790784 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.790972 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107262) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 13 02:26:18.791137 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.791497 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.791839 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.792172 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.792498 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.792885 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.793163 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.793490 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.793813 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.794171 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.794502 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.794828 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.795163 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.795496 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.795972 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.796158 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.796511 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.796832 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.797182 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.797517 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 13 02:26:18.797766 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=107263) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 13 02:26:18.813704 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_db.sqlalchemy.engines [None req-c59779a1-a7d3-4b67-99b3-dba622ba42e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107262) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 02:26:18.819889 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_db.sqlalchemy.engines [None req-06e9c9d4-f85c-4b43-b655-155a17667103 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107263) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 02:26:18.983742 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.context [None req-c59779a1-a7d3-4b67-99b3-dba622ba42e9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),94e222e8-b2ee-400d-b98b-1757bb81f73f(cell1) {{(pid=107262) load_cells /opt/stack/nova/nova/context.py:464}} Jul 13 02:26:18.988014 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c59779a1-a7d3-4b67-99b3-dba622ba42e9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:26:18.989408 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.context [None req-06e9c9d4-f85c-4b43-b655-155a17667103 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),94e222e8-b2ee-400d-b98b-1757bb81f73f(cell1) {{(pid=107263) load_cells /opt/stack/nova/nova/context.py:464}} Jul 13 02:26:18.989633 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c59779a1-a7d3-4b67-99b3-dba622ba42e9 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:26:18.990430 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c59779a1-a7d3-4b67-99b3-dba622ba42e9 None None] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:26:18.992373 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c59779a1-a7d3-4b67-99b3-dba622ba42e9 None None] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:26:18.993816 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-06e9c9d4-f85c-4b43-b655-155a17667103 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:26:18.995804 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-06e9c9d4-f85c-4b43-b655-155a17667103 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:26:18.996401 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-06e9c9d4-f85c-4b43-b655-155a17667103 None None] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:26:18.998492 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-06e9c9d4-f85c-4b43-b655-155a17667103 None None] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:26:19.004597 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_db.sqlalchemy.engines [None req-c59779a1-a7d3-4b67-99b3-dba622ba42e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107262) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 02:26:19.007238 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_db.sqlalchemy.engines [None req-c59779a1-a7d3-4b67-99b3-dba622ba42e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107262) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 02:26:19.010522 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_db.sqlalchemy.engines [None req-06e9c9d4-f85c-4b43-b655-155a17667103 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107263) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 02:26:19.016175 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_db.sqlalchemy.engines [None req-06e9c9d4-f85c-4b43-b655-155a17667103 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107263) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 02:26:19.029902 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:439: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:26:19.029902 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return dict(min_versions) Jul 13 02:26:19.030465 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:439: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:26:19.030465 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return dict(min_versions) Jul 13 02:26:19.278823 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_db.sqlalchemy.engines [None req-06e9c9d4-f85c-4b43-b655-155a17667103 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107263) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 02:26:19.280198 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_db.sqlalchemy.engines [None req-c59779a1-a7d3-4b67-99b3-dba622ba42e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=107262) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 13 02:26:19.292841 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:505: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:26:19.292841 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = model_query(context, models.Service, read_deleted="no").\ Jul 13 02:26:19.293352 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:505: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:26:19.293352 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = model_query(context, models.Service, read_deleted="no").\ Jul 13 02:26:19.609400 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: WARNING keystonemiddleware.auth_token [None req-c59779a1-a7d3-4b67-99b3-dba622ba42e9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 13 02:26:19.614458 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: WARNING keystonemiddleware.auth_token [None req-06e9c9d4-f85c-4b43-b655-155a17667103 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 13 02:26:19.616627 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: WARNING keystonemiddleware.auth_token [None req-c59779a1-a7d3-4b67-99b3-dba622ba42e9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 13 02:26:19.621613 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: WARNING keystonemiddleware.auth_token [None req-06e9c9d4-f85c-4b43-b655-155a17667103 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 13 02:26:19.965781 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: WARNING keystonemiddleware.auth_token [None req-c59779a1-a7d3-4b67-99b3-dba622ba42e9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 13 02:26:19.970993 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: WARNING keystonemiddleware.auth_token [None req-c59779a1-a7d3-4b67-99b3-dba622ba42e9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 13 02:26:19.972267 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: WARNING keystonemiddleware.auth_token [None req-06e9c9d4-f85c-4b43-b655-155a17667103 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 13 02:26:19.976361 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558b518659c0 pid: 107262 (default app) Jul 13 02:26:19.977434 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: WARNING keystonemiddleware.auth_token [None req-06e9c9d4-f85c-4b43-b655-155a17667103 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 13 02:26:19.982850 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558b518659c0 pid: 107263 (default app) Jul 13 02:26:53.407776 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-f7177690-c212-4832-a060-09242626214b tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1826563360", "imageRef": "1a3efd47-3618-4abd-b00b-a9fa9b90b4d4", "flavorRef": "452", "networks": [{"uuid": "b727df07-3cfb-4e7d-b024-f9ed9a0c1d4a"}]}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:26:54.328907 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.network.neutron [None req-f7177690-c212-4832-a060-09242626214b tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] validate_networks() for [('b727df07-3cfb-4e7d-b024-f9ed9a0c1d4a', None, None, None)] {{(pid=107262) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Jul 13 02:26:56.239941 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-0881865e-c2d1-43a7-9c9c-a95efc004064 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1770099424", "imageRef": "1a3efd47-3618-4abd-b00b-a9fa9b90b4d4", "flavorRef": "452", "networks": [{"uuid": "bbf39b0f-a6a8-4156-9bab-028e4f2bf745"}]}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:26:56.719922 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.network.neutron [None req-0881865e-c2d1-43a7-9c9c-a95efc004064 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] validate_networks() for [('bbf39b0f-a6a8-4156-9bab-028e4f2bf745', None, None, None)] {{(pid=107263) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Jul 13 02:26:56.802404 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-f7177690-c212-4832-a060-09242626214b tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Flavor limits 0:0:0 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 02:26:56.802920 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-f7177690-c212-4832-a060-09242626214b tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Image limits 0:0:0 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 02:26:56.803395 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-f7177690-c212-4832-a060-09242626214b tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Flavor pref 0:0:0 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 02:26:56.803802 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-f7177690-c212-4832-a060-09242626214b tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Image pref 0:0:0 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 02:26:56.804279 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-f7177690-c212-4832-a060-09242626214b tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 02:26:56.831487 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2690: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:26:56.831487 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: user_quotas = model_query(context, models.ProjectUserQuota, Jul 13 02:26:56.841028 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f7177690-c212-4832-a060-09242626214b tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:26:56.848410 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f7177690-c212-4832-a060-09242626214b tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:26:56.849489 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f7177690-c212-4832-a060-09242626214b tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:26:56.850201 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f7177690-c212-4832-a060-09242626214b tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:26:56.870200 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/objects/instance.py:1537: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:26:56.870200 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: project_result = project_query.first() Jul 13 02:26:56.916792 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2708: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:26:56.916792 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: rows = model_query(context, models.Quota, read_deleted="no").\ Jul 13 02:26:56.926994 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.quota [None req-f7177690-c212-4832-a060-09242626214b tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Getting quotas for project 3b02533417754144803237804ba3c72d. Resources: {'ram', 'cores', 'instances'} {{(pid=107262) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 13 02:26:56.943483 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.quota [None req-f7177690-c212-4832-a060-09242626214b tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Getting quotas for user 2fd9c7709a68475abdb5aba9f475b865 and project 3b02533417754144803237804ba3c72d. Resources: {'ram', 'cores', 'instances'} {{(pid=107262) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 13 02:26:56.972135 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-f7177690-c212-4832-a060-09242626214b tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Going to run 1 instances... {{(pid=107262) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 13 02:26:56.975809 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-f7177690-c212-4832-a060-09242626214b tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] [instance: cdd6e2b3-3294-448d-b390-4340eb1cf4fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a3efd47-3618-4abd-b00b-a9fa9b90b4d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107262) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 13 02:26:57.091928 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-f7177690-c212-4832-a060-09242626214b tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.744309 Jul 13 02:26:57.093142 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 1/1] 10.222.0.32 () {60 vars in 1147 bytes} [Tue Jul 13 02:26:52 2021] POST /compute/v2.1/servers => generated 380 bytes in 4748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 02:26:57.104203 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-247e113c-cbe0-4354-9496-b61bb2797ed5 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:26:57.105029 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-247e113c-cbe0-4354-9496-b61bb2797ed5 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] [instance: cdd6e2b3-3294-448d-b390-4340eb1cf4fe] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:26:57.306946 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-247e113c-cbe0-4354-9496-b61bb2797ed5 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd9c7709a68475abdb5aba9f475b865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b02533417754144803237804ba3c72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:26:57.309905 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:26:57.309905 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:26:57.332193 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-247e113c-cbe0-4354-9496-b61bb2797ed5 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] 10.222.0.32 "GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe" status: 200 len: 1215 microversion: 2.1 time: 0.232738 Jul 13 02:26:57.343455 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 2/2] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:26:57 2021] GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe => generated 1215 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:26:58.353243 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-7454d91c-6c78-47b1-aa1d-1a0677436f48 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:26:58.354057 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-7454d91c-6c78-47b1-aa1d-1a0677436f48 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] [instance: cdd6e2b3-3294-448d-b390-4340eb1cf4fe] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:26:58.489666 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-7454d91c-6c78-47b1-aa1d-1a0677436f48 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd9c7709a68475abdb5aba9f475b865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b02533417754144803237804ba3c72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:26:58.493804 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:26:58.493804 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:26:58.505368 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-7454d91c-6c78-47b1-aa1d-1a0677436f48 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] 10.222.0.32 "GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe" status: 200 len: 1215 microversion: 2.1 time: 0.156842 Jul 13 02:26:58.508266 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 3/3] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:26:58 2021] GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe => generated 1215 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:26:59.112984 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-0881865e-c2d1-43a7-9c9c-a95efc004064 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Flavor limits 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 02:26:59.113547 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-0881865e-c2d1-43a7-9c9c-a95efc004064 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Image limits 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 02:26:59.114337 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-0881865e-c2d1-43a7-9c9c-a95efc004064 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Flavor pref 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 02:26:59.114986 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-0881865e-c2d1-43a7-9c9c-a95efc004064 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Image pref 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 02:26:59.115752 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-0881865e-c2d1-43a7-9c9c-a95efc004064 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 02:26:59.125891 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2690: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:26:59.125891 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: user_quotas = model_query(context, models.ProjectUserQuota, Jul 13 02:26:59.131414 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0881865e-c2d1-43a7-9c9c-a95efc004064 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:26:59.132178 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0881865e-c2d1-43a7-9c9c-a95efc004064 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:26:59.133699 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0881865e-c2d1-43a7-9c9c-a95efc004064 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:26:59.134489 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0881865e-c2d1-43a7-9c9c-a95efc004064 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:26:59.142526 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/objects/instance.py:1537: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:26:59.142526 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: project_result = project_query.first() Jul 13 02:26:59.162472 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2708: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:26:59.162472 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: rows = model_query(context, models.Quota, read_deleted="no").\ Jul 13 02:26:59.170333 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.quota [None req-0881865e-c2d1-43a7-9c9c-a95efc004064 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Getting quotas for project 6b3bcc4decdb4d42a7f3efd99887e102. Resources: {'ram', 'cores', 'instances'} {{(pid=107263) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 13 02:26:59.178450 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.quota [None req-0881865e-c2d1-43a7-9c9c-a95efc004064 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Getting quotas for user f236dcca98c04f60aa827231eede0815 and project 6b3bcc4decdb4d42a7f3efd99887e102. Resources: {'ram', 'cores', 'instances'} {{(pid=107263) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 13 02:26:59.196093 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-0881865e-c2d1-43a7-9c9c-a95efc004064 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Going to run 1 instances... {{(pid=107263) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 13 02:26:59.201043 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-0881865e-c2d1-43a7-9c9c-a95efc004064 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d7423adc-bb73-46e2-8ddf-203316b7094a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a3efd47-3618-4abd-b00b-a9fa9b90b4d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 13 02:26:59.394425 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-0881865e-c2d1-43a7-9c9c-a95efc004064 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.817228 Jul 13 02:26:59.395558 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 1/4] 10.222.0.32 () {60 vars in 1147 bytes} [Tue Jul 13 02:26:55 2021] POST /compute/v2.1/servers => generated 380 bytes in 3820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 13 02:26:59.405810 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-6b46e858-ed1a-4206-9d28-8c351d939efd tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:26:59.406688 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-6b46e858-ed1a-4206-9d28-8c351d939efd tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d7423adc-bb73-46e2-8ddf-203316b7094a] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:26:59.524511 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-ad8db342-4ab0-4dce-843b-9d9568a1f0a7 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:26:59.525319 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-ad8db342-4ab0-4dce-843b-9d9568a1f0a7 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] [instance: cdd6e2b3-3294-448d-b390-4340eb1cf4fe] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:26:59.554431 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ad8db342-4ab0-4dce-843b-9d9568a1f0a7 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:26:59.556065 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ad8db342-4ab0-4dce-843b-9d9568a1f0a7 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:26:59.557417 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-6b46e858-ed1a-4206-9d28-8c351d939efd tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:26:59.563296 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:26:59.563296 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:26:59.569682 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ad8db342-4ab0-4dce-843b-9d9568a1f0a7 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:26:59.570328 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ad8db342-4ab0-4dce-843b-9d9568a1f0a7 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:26:59.574528 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:26:59.574528 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:26:59.585611 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-6b46e858-ed1a-4206-9d28-8c351d939efd tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a" status: 200 len: 1218 microversion: 2.1 time: 0.182943 Jul 13 02:26:59.586397 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 4/5] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:26:59 2021] GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a => generated 1218 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:26:59.935208 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-ad8db342-4ab0-4dce-843b-9d9568a1f0a7 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd9c7709a68475abdb5aba9f475b865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b02533417754144803237804ba3c72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:26:59.940500 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:26:59.940500 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:26:59.970366 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-ad8db342-4ab0-4dce-843b-9d9568a1f0a7 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] 10.222.0.32 "GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe" status: 200 len: 1219 microversion: 2.1 time: 0.450129 Jul 13 02:26:59.972181 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 2/6] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:26:59 2021] GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe => generated 1219 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:00.606347 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-bf17023b-698f-49e4-964a-86312e959142 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:00.607130 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-bf17023b-698f-49e4-964a-86312e959142 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d7423adc-bb73-46e2-8ddf-203316b7094a] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:00.848762 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-bf17023b-698f-49e4-964a-86312e959142 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:00.852740 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:00.852740 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:00.860716 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-bf17023b-698f-49e4-964a-86312e959142 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a" status: 200 len: 1218 microversion: 2.1 time: 0.262010 Jul 13 02:27:00.862264 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 5/7] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:00 2021] GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a => generated 1218 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:00.991389 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-cf84b0fd-af2a-494d-9883-470ef6264988 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:00.992717 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-cf84b0fd-af2a-494d-9883-470ef6264988 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] [instance: cdd6e2b3-3294-448d-b390-4340eb1cf4fe] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:00.999128 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-cf84b0fd-af2a-494d-9883-470ef6264988 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:01.000178 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-cf84b0fd-af2a-494d-9883-470ef6264988 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:01.001707 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-cf84b0fd-af2a-494d-9883-470ef6264988 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:01.002166 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-cf84b0fd-af2a-494d-9883-470ef6264988 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:01.015255 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:01.015255 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:01.256682 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-cf84b0fd-af2a-494d-9883-470ef6264988 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd9c7709a68475abdb5aba9f475b865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b02533417754144803237804ba3c72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:01.260054 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:01.260054 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:01.294814 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-cf84b0fd-af2a-494d-9883-470ef6264988 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] 10.222.0.32 "GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe" status: 200 len: 1219 microversion: 2.1 time: 0.305395 Jul 13 02:27:01.296390 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 3/8] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:00 2021] GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe => generated 1219 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:01.880231 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-c332446c-21f5-4a2d-8cc0-d087e2b8dab4 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:01.880838 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-c332446c-21f5-4a2d-8cc0-d087e2b8dab4 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d7423adc-bb73-46e2-8ddf-203316b7094a] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:01.889898 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c332446c-21f5-4a2d-8cc0-d087e2b8dab4 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:01.895199 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c332446c-21f5-4a2d-8cc0-d087e2b8dab4 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:01.896042 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c332446c-21f5-4a2d-8cc0-d087e2b8dab4 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:01.898019 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c332446c-21f5-4a2d-8cc0-d087e2b8dab4 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:01.901904 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:01.901904 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:02.222610 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-c332446c-21f5-4a2d-8cc0-d087e2b8dab4 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:02.231437 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:02.231437 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:02.250519 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-c332446c-21f5-4a2d-8cc0-d087e2b8dab4 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a" status: 200 len: 1214 microversion: 2.1 time: 0.375300 Jul 13 02:27:02.251954 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 6/9] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:01 2021] GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a => generated 1214 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:02.315171 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-bd88b5fd-4306-49a3-8800-cc0e2f1dcc48 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:02.316342 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-bd88b5fd-4306-49a3-8800-cc0e2f1dcc48 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] [instance: cdd6e2b3-3294-448d-b390-4340eb1cf4fe] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:02.328757 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-bd88b5fd-4306-49a3-8800-cc0e2f1dcc48 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:02.329329 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-bd88b5fd-4306-49a3-8800-cc0e2f1dcc48 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:02.330239 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-bd88b5fd-4306-49a3-8800-cc0e2f1dcc48 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:02.330765 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-bd88b5fd-4306-49a3-8800-cc0e2f1dcc48 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:02.334582 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:02.334582 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:03.067247 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-bd88b5fd-4306-49a3-8800-cc0e2f1dcc48 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd9c7709a68475abdb5aba9f475b865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b02533417754144803237804ba3c72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:03.070534 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:03.070534 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:03.083544 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-bd88b5fd-4306-49a3-8800-cc0e2f1dcc48 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] 10.222.0.32 "GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe" status: 200 len: 1267 microversion: 2.1 time: 0.773833 Jul 13 02:27:03.084144 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 4/10] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:02 2021] GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe => generated 1267 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:03.270065 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-7d6d8c28-faca-4dd8-9bdf-cc09adadbc2e tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:03.271296 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-7d6d8c28-faca-4dd8-9bdf-cc09adadbc2e tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d7423adc-bb73-46e2-8ddf-203316b7094a] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:03.286720 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7d6d8c28-faca-4dd8-9bdf-cc09adadbc2e tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:03.291310 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7d6d8c28-faca-4dd8-9bdf-cc09adadbc2e tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:03.292301 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7d6d8c28-faca-4dd8-9bdf-cc09adadbc2e tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:03.292742 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7d6d8c28-faca-4dd8-9bdf-cc09adadbc2e tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:03.306773 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:03.306773 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:03.694468 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-7d6d8c28-faca-4dd8-9bdf-cc09adadbc2e tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:03.699106 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:03.699106 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:03.710212 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-7d6d8c28-faca-4dd8-9bdf-cc09adadbc2e tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a" status: 200 len: 1214 microversion: 2.1 time: 0.444502 Jul 13 02:27:03.736618 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 7/11] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:03 2021] GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a => generated 1214 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:04.105788 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-3f6c2294-fff4-4a67-8ef0-98551dab8c15 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:04.107022 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-3f6c2294-fff4-4a67-8ef0-98551dab8c15 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] [instance: cdd6e2b3-3294-448d-b390-4340eb1cf4fe] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:04.131653 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-3f6c2294-fff4-4a67-8ef0-98551dab8c15 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:04.132759 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-3f6c2294-fff4-4a67-8ef0-98551dab8c15 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:04.135925 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-3f6c2294-fff4-4a67-8ef0-98551dab8c15 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:04.135925 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-3f6c2294-fff4-4a67-8ef0-98551dab8c15 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:04.139554 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:04.139554 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:04.512358 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-3f6c2294-fff4-4a67-8ef0-98551dab8c15 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd9c7709a68475abdb5aba9f475b865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b02533417754144803237804ba3c72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:04.515987 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:04.515987 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:04.548178 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-3f6c2294-fff4-4a67-8ef0-98551dab8c15 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] 10.222.0.32 "GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe" status: 200 len: 1273 microversion: 2.1 time: 0.447697 Jul 13 02:27:04.549759 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 5/12] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:04 2021] GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe => generated 1273 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:04.749892 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-2d0208e7-873f-4a44-b794-d36bcf0add2c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:04.750687 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-2d0208e7-873f-4a44-b794-d36bcf0add2c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d7423adc-bb73-46e2-8ddf-203316b7094a] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:04.772489 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2d0208e7-873f-4a44-b794-d36bcf0add2c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:04.773083 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2d0208e7-873f-4a44-b794-d36bcf0add2c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:04.777384 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2d0208e7-873f-4a44-b794-d36bcf0add2c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:04.790890 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2d0208e7-873f-4a44-b794-d36bcf0add2c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:04.808246 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:04.808246 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:05.478469 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-2d0208e7-873f-4a44-b794-d36bcf0add2c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:05.481226 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:05.481226 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:05.508949 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-2d0208e7-873f-4a44-b794-d36bcf0add2c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a" status: 200 len: 1288 microversion: 2.1 time: 0.768579 Jul 13 02:27:05.522990 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 8/13] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:04 2021] GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a => generated 1288 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:05.567585 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-93afb2a5-2bcf-448f-acac-61d18e8d5d58 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:05.570091 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-93afb2a5-2bcf-448f-acac-61d18e8d5d58 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] [instance: cdd6e2b3-3294-448d-b390-4340eb1cf4fe] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:05.578219 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-93afb2a5-2bcf-448f-acac-61d18e8d5d58 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:05.579560 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-93afb2a5-2bcf-448f-acac-61d18e8d5d58 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:05.581790 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-93afb2a5-2bcf-448f-acac-61d18e8d5d58 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:05.582673 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-93afb2a5-2bcf-448f-acac-61d18e8d5d58 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:05.589141 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:05.589141 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:06.247094 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-1f41e46b-9420-4733-a617-253442eaa888 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'create', calling method: .version_select at 0x7f4314c84a60>, body: {"keypair": {"name": "tempest-keypair-1290995771"}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:27:06.283927 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2656: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:06.283927 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return model_query(context, models.KeyPair, read_deleted="no").\ Jul 13 02:27:06.312019 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2708: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:06.312019 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: rows = model_query(context, models.Quota, read_deleted="no").\ Jul 13 02:27:06.318786 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.quota [None req-1f41e46b-9420-4733-a617-253442eaa888 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Getting quotas for project 197b525e7a104e5ebcd262a734055741. Resources: {'key_pairs'} {{(pid=107262) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 13 02:27:06.328272 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.quota [None req-1f41e46b-9420-4733-a617-253442eaa888 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Getting quotas for user 1d3696355aae4727ae610990c9efb5eb and project 197b525e7a104e5ebcd262a734055741. Resources: {'key_pairs'} {{(pid=107262) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 13 02:27:06.346649 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2690: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:06.346649 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: user_quotas = model_query(context, models.ProjectUserQuota, Jul 13 02:27:06.355037 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-93afb2a5-2bcf-448f-acac-61d18e8d5d58 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd9c7709a68475abdb5aba9f475b865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b02533417754144803237804ba3c72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:06.357781 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:06.357781 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:06.366465 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-93afb2a5-2bcf-448f-acac-61d18e8d5d58 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] 10.222.0.32 "GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe" status: 200 len: 1273 microversion: 2.1 time: 0.804193 Jul 13 02:27:06.375985 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 6/14] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:05 2021] GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe => generated 1273 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:06.551618 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-59da8327-fa76-4711-8956-736452e55f96 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:06.552610 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-59da8327-fa76-4711-8956-736452e55f96 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d7423adc-bb73-46e2-8ddf-203316b7094a] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:06.558525 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2621: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:06.558525 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = model_query(context, models.KeyPair).\ Jul 13 02:27:06.563478 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-59da8327-fa76-4711-8956-736452e55f96 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:06.564245 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-59da8327-fa76-4711-8956-736452e55f96 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:06.565271 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-59da8327-fa76-4711-8956-736452e55f96 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:06.565930 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-59da8327-fa76-4711-8956-736452e55f96 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:06.578433 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:06.578433 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:06.644357 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.quota [None req-1f41e46b-9420-4733-a617-253442eaa888 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Getting quotas for project 197b525e7a104e5ebcd262a734055741. Resources: {'key_pairs'} {{(pid=107262) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 13 02:27:06.657226 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.quota [None req-1f41e46b-9420-4733-a617-253442eaa888 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Getting quotas for user 1d3696355aae4727ae610990c9efb5eb and project 197b525e7a104e5ebcd262a734055741. Resources: {'key_pairs'} {{(pid=107262) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 13 02:27:06.699335 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-1f41e46b-9420-4733-a617-253442eaa888 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.867401 Jul 13 02:27:06.702162 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 9/15] 10.222.0.32 () {60 vars in 1158 bytes} [Tue Jul 13 02:27:05 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:06.937411 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-59da8327-fa76-4711-8956-736452e55f96 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:06.940348 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:06.940348 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:06.968709 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-59da8327-fa76-4711-8956-736452e55f96 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a" status: 200 len: 1276 microversion: 2.1 time: 0.417843 Jul 13 02:27:06.982006 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 7/16] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:06 2021] GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a => generated 1276 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:07.393616 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-c566d190-abd1-41c5-81ae-2414fff8ceeb tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:07.394922 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-c566d190-abd1-41c5-81ae-2414fff8ceeb tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] [instance: cdd6e2b3-3294-448d-b390-4340eb1cf4fe] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:07.412590 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c566d190-abd1-41c5-81ae-2414fff8ceeb tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:07.413254 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c566d190-abd1-41c5-81ae-2414fff8ceeb tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:07.414378 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c566d190-abd1-41c5-81ae-2414fff8ceeb tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:07.422840 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c566d190-abd1-41c5-81ae-2414fff8ceeb tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:07.428776 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:07.428776 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:07.929886 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-c566d190-abd1-41c5-81ae-2414fff8ceeb tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd9c7709a68475abdb5aba9f475b865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b02533417754144803237804ba3c72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:07.933082 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:07.933082 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:07.948326 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-c566d190-abd1-41c5-81ae-2414fff8ceeb tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] 10.222.0.32 "GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe" status: 200 len: 1273 microversion: 2.1 time: 0.558440 Jul 13 02:27:07.961551 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 10/17] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:07 2021] GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe => generated 1273 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:07.990690 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-2fe9b057-5b6e-4231-a91a-1d97315e33a1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:07.991346 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-2fe9b057-5b6e-4231-a91a-1d97315e33a1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d7423adc-bb73-46e2-8ddf-203316b7094a] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:08.016717 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2fe9b057-5b6e-4231-a91a-1d97315e33a1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:08.017351 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2fe9b057-5b6e-4231-a91a-1d97315e33a1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:08.018364 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2fe9b057-5b6e-4231-a91a-1d97315e33a1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:08.022732 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2fe9b057-5b6e-4231-a91a-1d97315e33a1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:08.034001 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:08.034001 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:08.534991 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-2fe9b057-5b6e-4231-a91a-1d97315e33a1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:08.537508 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:08.537508 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:08.556101 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-2fe9b057-5b6e-4231-a91a-1d97315e33a1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a" status: 200 len: 1276 microversion: 2.1 time: 0.570072 Jul 13 02:27:08.579616 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 8/18] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:07 2021] GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a => generated 1276 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:08.979452 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-65f8dc52-011f-4999-929f-8b2dae1d1f71 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:08.992937 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-65f8dc52-011f-4999-929f-8b2dae1d1f71 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] [instance: cdd6e2b3-3294-448d-b390-4340eb1cf4fe] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:09.028457 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-65f8dc52-011f-4999-929f-8b2dae1d1f71 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:09.031345 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-65f8dc52-011f-4999-929f-8b2dae1d1f71 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:09.035187 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-65f8dc52-011f-4999-929f-8b2dae1d1f71 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:09.037041 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-65f8dc52-011f-4999-929f-8b2dae1d1f71 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:09.056332 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:09.056332 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:09.593737 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-dbd4c32d-336f-4057-8c84-49e14d245c92 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:09.594892 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-dbd4c32d-336f-4057-8c84-49e14d245c92 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d7423adc-bb73-46e2-8ddf-203316b7094a] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:09.626101 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-dbd4c32d-336f-4057-8c84-49e14d245c92 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:09.627340 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-dbd4c32d-336f-4057-8c84-49e14d245c92 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:09.634646 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-dbd4c32d-336f-4057-8c84-49e14d245c92 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:09.637144 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-dbd4c32d-336f-4057-8c84-49e14d245c92 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:09.658304 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:09.658304 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:10.086347 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-dbd4c32d-336f-4057-8c84-49e14d245c92 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:10.089629 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:10.089629 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:10.097459 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-dbd4c32d-336f-4057-8c84-49e14d245c92 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a" status: 200 len: 1276 microversion: 2.1 time: 0.515084 Jul 13 02:27:10.098101 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 9/19] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:09 2021] GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a => generated 1276 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:27:10.110363 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-65f8dc52-011f-4999-929f-8b2dae1d1f71 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd9c7709a68475abdb5aba9f475b865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b02533417754144803237804ba3c72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:10.115537 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:10.115537 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:10.128648 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-65f8dc52-011f-4999-929f-8b2dae1d1f71 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] 10.222.0.32 "GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe" status: 200 len: 1315 microversion: 2.1 time: 1.154274 Jul 13 02:27:10.143394 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 11/20] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:08 2021] GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe => generated 1315 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:11.114917 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-e1e3d65a-d404-4cd8-8092-1b92467fbd87 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:11.115721 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-e1e3d65a-d404-4cd8-8092-1b92467fbd87 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d7423adc-bb73-46e2-8ddf-203316b7094a] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:11.128319 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e1e3d65a-d404-4cd8-8092-1b92467fbd87 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:11.132150 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e1e3d65a-d404-4cd8-8092-1b92467fbd87 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:11.137969 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e1e3d65a-d404-4cd8-8092-1b92467fbd87 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:11.144088 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e1e3d65a-d404-4cd8-8092-1b92467fbd87 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:11.149608 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-52ad38d9-41ce-47a7-98c2-fed61591ba19 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:11.150340 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-52ad38d9-41ce-47a7-98c2-fed61591ba19 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] [instance: cdd6e2b3-3294-448d-b390-4340eb1cf4fe] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:11.153067 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:11.153067 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:11.169159 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-52ad38d9-41ce-47a7-98c2-fed61591ba19 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:11.173229 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-52ad38d9-41ce-47a7-98c2-fed61591ba19 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:11.177864 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-52ad38d9-41ce-47a7-98c2-fed61591ba19 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:11.178465 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-52ad38d9-41ce-47a7-98c2-fed61591ba19 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:11.197326 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:11.197326 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:13.182216 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-52ad38d9-41ce-47a7-98c2-fed61591ba19 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd9c7709a68475abdb5aba9f475b865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b02533417754144803237804ba3c72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:13.184790 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:13.184790 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:13.209983 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-52ad38d9-41ce-47a7-98c2-fed61591ba19 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] 10.222.0.32 "GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe" status: 200 len: 1315 microversion: 2.1 time: 2.064698 Jul 13 02:27:13.226722 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 12/21] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:11 2021] GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe => generated 1315 bytes in 2082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:13.373032 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-e1e3d65a-d404-4cd8-8092-1b92467fbd87 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:13.376284 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:13.376284 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:13.399243 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-e1e3d65a-d404-4cd8-8092-1b92467fbd87 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a" status: 200 len: 1318 microversion: 2.1 time: 2.285031 Jul 13 02:27:13.403194 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 10/22] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:11 2021] GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a => generated 1318 bytes in 2292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:13.968643 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-dc6fb9f1-39ac-49f5-a80d-69eeaa9c4482 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'create', calling method: .version_select at 0x7f43130c64c0>, body: {"keypair": {"name": "tempest-keypair-1055037345"}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:27:13.980800 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2656: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:13.980800 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return model_query(context, models.KeyPair, read_deleted="no").\ Jul 13 02:27:14.012827 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2708: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:14.012827 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: rows = model_query(context, models.Quota, read_deleted="no").\ Jul 13 02:27:14.031277 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.quota [None req-dc6fb9f1-39ac-49f5-a80d-69eeaa9c4482 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Getting quotas for project 63a044a9d95c49ce9281f67e741cf8ad. Resources: {'key_pairs'} {{(pid=107262) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 13 02:27:14.060010 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.quota [None req-dc6fb9f1-39ac-49f5-a80d-69eeaa9c4482 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Getting quotas for user a5fff5f367864fbb9a8731f6dfbc4d62 and project 63a044a9d95c49ce9281f67e741cf8ad. Resources: {'key_pairs'} {{(pid=107262) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 13 02:27:14.071632 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2690: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:14.071632 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: user_quotas = model_query(context, models.ProjectUserQuota, Jul 13 02:27:14.228601 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-910e3070-4c3d-46cd-bf80-528e1658434b tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:14.229218 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-910e3070-4c3d-46cd-bf80-528e1658434b tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] [instance: cdd6e2b3-3294-448d-b390-4340eb1cf4fe] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:14.240014 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-910e3070-4c3d-46cd-bf80-528e1658434b tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:14.240499 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-910e3070-4c3d-46cd-bf80-528e1658434b tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:14.249162 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-910e3070-4c3d-46cd-bf80-528e1658434b tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:14.249780 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-910e3070-4c3d-46cd-bf80-528e1658434b tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:14.279876 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:14.279876 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:14.341243 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2621: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:14.341243 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = model_query(context, models.KeyPair).\ Jul 13 02:27:14.417745 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.quota [None req-dc6fb9f1-39ac-49f5-a80d-69eeaa9c4482 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Getting quotas for project 63a044a9d95c49ce9281f67e741cf8ad. Resources: {'key_pairs'} {{(pid=107262) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 13 02:27:14.439308 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.quota [None req-dc6fb9f1-39ac-49f5-a80d-69eeaa9c4482 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Getting quotas for user a5fff5f367864fbb9a8731f6dfbc4d62 and project 63a044a9d95c49ce9281f67e741cf8ad. Resources: {'key_pairs'} {{(pid=107262) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 13 02:27:14.477092 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-dc6fb9f1-39ac-49f5-a80d-69eeaa9c4482 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 1.248504 Jul 13 02:27:14.477967 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 13/23] 10.222.0.32 () {62 vars in 1199 bytes} [Tue Jul 13 02:27:13 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1251 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Jul 13 02:27:14.482939 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-5a674210-eb36-4306-9b2b-111923f29171 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:14.493923 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-5a674210-eb36-4306-9b2b-111923f29171 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d7423adc-bb73-46e2-8ddf-203316b7094a] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:14.511462 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5a674210-eb36-4306-9b2b-111923f29171 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:14.511890 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5a674210-eb36-4306-9b2b-111923f29171 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:14.513589 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5a674210-eb36-4306-9b2b-111923f29171 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:14.514243 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5a674210-eb36-4306-9b2b-111923f29171 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:14.519514 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:14.519514 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:15.546879 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-910e3070-4c3d-46cd-bf80-528e1658434b tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd9c7709a68475abdb5aba9f475b865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b02533417754144803237804ba3c72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:15.551364 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:15.551364 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:15.565096 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-910e3070-4c3d-46cd-bf80-528e1658434b tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] 10.222.0.32 "GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe" status: 200 len: 1315 microversion: 2.1 time: 1.339695 Jul 13 02:27:15.580238 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 11/24] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:14 2021] GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe => generated 1315 bytes in 1357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:27:15.619736 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-5a674210-eb36-4306-9b2b-111923f29171 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:15.622553 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:15.622553 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:15.649596 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-5a674210-eb36-4306-9b2b-111923f29171 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a" status: 200 len: 1318 microversion: 2.1 time: 1.167461 Jul 13 02:27:15.650277 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 14/25] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:14 2021] GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a => generated 1318 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:16.170652 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-27b6be80-67fe-4776-aa1b-f76d7a7705c1 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-901974715", "imageRef": "1a3efd47-3618-4abd-b00b-a9fa9b90b4d4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5ee15f4b-e9bf-48da-8980-d1fd54d9c0d3"}]}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:27:16.292539 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.network.neutron [None req-27b6be80-67fe-4776-aa1b-f76d7a7705c1 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] validate_networks() for [('5ee15f4b-e9bf-48da-8980-d1fd54d9c0d3', None, None, None)] {{(pid=107263) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Jul 13 02:27:16.586745 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-e94c4b35-d38c-42cf-a9df-56a385ebbd8a tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:16.587950 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-e94c4b35-d38c-42cf-a9df-56a385ebbd8a tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] [instance: cdd6e2b3-3294-448d-b390-4340eb1cf4fe] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:16.612672 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e94c4b35-d38c-42cf-a9df-56a385ebbd8a tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:16.613488 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e94c4b35-d38c-42cf-a9df-56a385ebbd8a tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:16.614635 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e94c4b35-d38c-42cf-a9df-56a385ebbd8a tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:16.615276 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e94c4b35-d38c-42cf-a9df-56a385ebbd8a tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:16.619899 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:16.619899 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:17.513629 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-e94c4b35-d38c-42cf-a9df-56a385ebbd8a tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd9c7709a68475abdb5aba9f475b865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b02533417754144803237804ba3c72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:17.516646 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:17.516646 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:17.535545 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-e94c4b35-d38c-42cf-a9df-56a385ebbd8a tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] 10.222.0.32 "GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe" status: 200 len: 1315 microversion: 2.1 time: 0.954505 Jul 13 02:27:17.536811 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 15/26] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:16 2021] GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe => generated 1315 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:17.549510 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-ea6c71c5-3148-420d-bcc4-14d3146f01d8 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:17.550701 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-ea6c71c5-3148-420d-bcc4-14d3146f01d8 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d7423adc-bb73-46e2-8ddf-203316b7094a] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:17.565900 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ea6c71c5-3148-420d-bcc4-14d3146f01d8 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:17.566817 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ea6c71c5-3148-420d-bcc4-14d3146f01d8 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:17.568032 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ea6c71c5-3148-420d-bcc4-14d3146f01d8 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:17.568774 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ea6c71c5-3148-420d-bcc4-14d3146f01d8 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:17.587477 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:17.587477 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:18.838844 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-ea6c71c5-3148-420d-bcc4-14d3146f01d8 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:18.841430 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:18.841430 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:18.854766 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-ea6c71c5-3148-420d-bcc4-14d3146f01d8 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a" status: 200 len: 1318 microversion: 2.1 time: 1.316469 Jul 13 02:27:18.855461 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 16/27] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:17 2021] GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a => generated 1318 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:19.346535 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-27b6be80-67fe-4776-aa1b-f76d7a7705c1 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Flavor limits 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 02:27:19.347721 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-27b6be80-67fe-4776-aa1b-f76d7a7705c1 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Image limits 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 02:27:19.348224 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-27b6be80-67fe-4776-aa1b-f76d7a7705c1 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Flavor pref 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 02:27:19.348773 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-27b6be80-67fe-4776-aa1b-f76d7a7705c1 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Image pref 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 02:27:19.349514 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-27b6be80-67fe-4776-aa1b-f76d7a7705c1 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 02:27:19.361337 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2690: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:19.361337 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: user_quotas = model_query(context, models.ProjectUserQuota, Jul 13 02:27:19.370899 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-27b6be80-67fe-4776-aa1b-f76d7a7705c1 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:19.371704 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-27b6be80-67fe-4776-aa1b-f76d7a7705c1 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:19.373821 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-27b6be80-67fe-4776-aa1b-f76d7a7705c1 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:19.376754 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-27b6be80-67fe-4776-aa1b-f76d7a7705c1 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:19.384530 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/objects/instance.py:1537: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:19.384530 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: project_result = project_query.first() Jul 13 02:27:19.412438 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-d4ac2ec0-319d-4956-9027-94f85c3abb23 req-53d2ccdb-80d0-4826-9305-0728a686bd78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdd6e2b3-3294-448d-b390-4340eb1cf4fe", "tag": "a8589fd5-f6a3-4169-9e78-c802007a1513"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:27:19.414986 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:27:19.414986 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:27:19.418681 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2708: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:19.418681 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: rows = model_query(context, models.Quota, read_deleted="no").\ Jul 13 02:27:19.423266 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.quota [None req-27b6be80-67fe-4776-aa1b-f76d7a7705c1 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Getting quotas for project cc0ee8f5f4bc44599b259e826174d9ae. Resources: {'ram', 'cores', 'instances'} {{(pid=107263) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 13 02:27:19.427931 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.quota [None req-27b6be80-67fe-4776-aa1b-f76d7a7705c1 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Getting quotas for user c7b72418c3974756b604d0acb2c8188b and project cc0ee8f5f4bc44599b259e826174d9ae. Resources: {'ram', 'cores', 'instances'} {{(pid=107263) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 13 02:27:19.442767 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-27b6be80-67fe-4776-aa1b-f76d7a7705c1 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Going to run 1 instances... {{(pid=107263) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 13 02:27:19.445006 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-27b6be80-67fe-4776-aa1b-f76d7a7705c1 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a3efd47-3618-4abd-b00b-a9fa9b90b4d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 13 02:27:19.448239 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-d4ac2ec0-319d-4956-9027-94f85c3abb23 req-53d2ccdb-80d0-4826-9305-0728a686bd78 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:19.448727 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-d4ac2ec0-319d-4956-9027-94f85c3abb23 req-53d2ccdb-80d0-4826-9305-0728a686bd78 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:19.549302 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-27b6be80-67fe-4776-aa1b-f76d7a7705c1 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.845339 Jul 13 02:27:19.550692 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 12/28] 10.222.0.32 () {60 vars in 1147 bytes} [Tue Jul 13 02:27:15 2021] POST /compute/v2.1/servers => generated 383 bytes in 3847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 02:27:19.559301 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-c0533b22-33d0-49e3-bb49-edb1852fd8dc tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:19.559998 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-c0533b22-33d0-49e3-bb49-edb1852fd8dc tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] [instance: cdd6e2b3-3294-448d-b390-4340eb1cf4fe] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:19.568541 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c0533b22-33d0-49e3-bb49-edb1852fd8dc tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:19.569194 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c0533b22-33d0-49e3-bb49-edb1852fd8dc tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:19.571166 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c0533b22-33d0-49e3-bb49-edb1852fd8dc tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:19.571850 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c0533b22-33d0-49e3-bb49-edb1852fd8dc tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:19.575657 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:19.575657 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:19.627383 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-d4ac2ec0-319d-4956-9027-94f85c3abb23 req-53d2ccdb-80d0-4826-9305-0728a686bd78 service nova] Creating event network-changed:a8589fd5-f6a3-4169-9e78-c802007a1513 for instance cdd6e2b3-3294-448d-b390-4340eb1cf4fe on hv-cinder-78102 Jul 13 02:27:19.628932 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-d4ac2ec0-319d-4956-9027-94f85c3abb23 req-53d2ccdb-80d0-4826-9305-0728a686bd78 service nova] Acquired lock "compute-rpcapi-router" {{(pid=107262) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Jul 13 02:27:19.632061 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-43990803-efbc-488a-beed-a9b431a362c4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:19.632770 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-43990803-efbc-488a-beed-a9b431a362c4 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:19.635927 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-43990803-efbc-488a-beed-a9b431a362c4 None None] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:19.639624 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-43990803-efbc-488a-beed-a9b431a362c4 None None] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:19.661535 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:439: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:19.661535 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return dict(min_versions) Jul 13 02:27:19.690387 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.compute.rpcapi [None req-43990803-efbc-488a-beed-a9b431a362c4 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Jul 13 02:27:19.692918 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-43990803-efbc-488a-beed-a9b431a362c4 None None] Releasing lock "compute-rpcapi-router" {{(pid=107262) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Jul 13 02:27:19.771911 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-43990803-efbc-488a-beed-a9b431a362c4 None None] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.915148 Jul 13 02:27:19.773275 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 17/29] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:27:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:27:19.779027 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-6b304fcd-038f-428c-bfad-8a3f9bbe8acb tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:19.779921 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-6b304fcd-038f-428c-bfad-8a3f9bbe8acb tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:19.894841 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-6b304fcd-038f-428c-bfad-8a3f9bbe8acb tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:19.898775 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:19.898775 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:19.911775 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-6b304fcd-038f-428c-bfad-8a3f9bbe8acb tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1221 microversion: 2.1 time: 0.135620 Jul 13 02:27:19.914321 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 18/30] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:19 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1221 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:19.925773 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-10c6d6d0-b0d0-4fec-a2e9-cf6a1f92485e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1642813517", "imageRef": "1a3efd47-3618-4abd-b00b-a9fa9b90b4d4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c480eb56-38cb-46d3-accb-fb773d7ee254"}], "security_groups": [{"name": "tempest-securitygroup--1391367236"}], "key_name": "tempest-keypair-1290995771", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:27:20.223937 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-c0533b22-33d0-49e3-bb49-edb1852fd8dc tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd9c7709a68475abdb5aba9f475b865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b02533417754144803237804ba3c72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:20.227080 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:20.227080 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:20.244226 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-c0533b22-33d0-49e3-bb49-edb1852fd8dc tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] 10.222.0.32 "GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe" status: 200 len: 1315 microversion: 2.1 time: 0.685494 Jul 13 02:27:20.245192 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 13/31] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:19 2021] GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe => generated 1315 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:20.250635 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-d1cae4dd-fefc-4471-b325-b74b1b133df6 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:20.252670 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-d1cae4dd-fefc-4471-b325-b74b1b133df6 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d7423adc-bb73-46e2-8ddf-203316b7094a] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:20.269561 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d1cae4dd-fefc-4471-b325-b74b1b133df6 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:20.279848 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d1cae4dd-fefc-4471-b325-b74b1b133df6 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:20.280900 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d1cae4dd-fefc-4471-b325-b74b1b133df6 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:20.281353 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d1cae4dd-fefc-4471-b325-b74b1b133df6 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:20.292604 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:20.292604 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:20.479884 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.network.neutron [None req-10c6d6d0-b0d0-4fec-a2e9-cf6a1f92485e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] validate_networks() for [('c480eb56-38cb-46d3-accb-fb773d7ee254', None, None, None)] {{(pid=107262) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Jul 13 02:27:20.981553 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-d1cae4dd-fefc-4471-b325-b74b1b133df6 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:20.986739 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:20.986739 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:21.001171 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-d1cae4dd-fefc-4471-b325-b74b1b133df6 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a" status: 200 len: 1318 microversion: 2.1 time: 0.754649 Jul 13 02:27:21.001802 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 14/32] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:20 2021] GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a => generated 1318 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:21.006747 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-709a6c1d-17cc-4ee7-ab07-809f3d03cefe tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-644341271", "imageRef": "1a3efd47-3618-4abd-b00b-a9fa9b90b4d4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5ee15f4b-e9bf-48da-8980-d1fd54d9c0d3"}]}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:27:21.084842 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.network.neutron [None req-709a6c1d-17cc-4ee7-ab07-809f3d03cefe tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] validate_networks() for [('5ee15f4b-e9bf-48da-8980-d1fd54d9c0d3', None, None, None)] {{(pid=107263) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Jul 13 02:27:21.989805 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-10c6d6d0-b0d0-4fec-a2e9-cf6a1f92485e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Flavor limits 0:0:0 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 02:27:21.993371 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-10c6d6d0-b0d0-4fec-a2e9-cf6a1f92485e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Image limits 0:0:0 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 02:27:21.994141 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-10c6d6d0-b0d0-4fec-a2e9-cf6a1f92485e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Flavor pref 0:0:0 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 02:27:21.996430 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-10c6d6d0-b0d0-4fec-a2e9-cf6a1f92485e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Image pref 0:0:0 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 02:27:21.997058 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-10c6d6d0-b0d0-4fec-a2e9-cf6a1f92485e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 02:27:22.013782 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2690: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:22.013782 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: user_quotas = model_query(context, models.ProjectUserQuota, Jul 13 02:27:22.034598 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-10c6d6d0-b0d0-4fec-a2e9-cf6a1f92485e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:22.035048 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-10c6d6d0-b0d0-4fec-a2e9-cf6a1f92485e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:22.040681 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-10c6d6d0-b0d0-4fec-a2e9-cf6a1f92485e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:22.042003 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-10c6d6d0-b0d0-4fec-a2e9-cf6a1f92485e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:22.051605 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/objects/instance.py:1537: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:22.051605 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: project_result = project_query.first() Jul 13 02:27:22.072756 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2708: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:22.072756 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: rows = model_query(context, models.Quota, read_deleted="no").\ Jul 13 02:27:22.078253 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.quota [None req-10c6d6d0-b0d0-4fec-a2e9-cf6a1f92485e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Getting quotas for project 197b525e7a104e5ebcd262a734055741. Resources: {'ram', 'cores', 'instances'} {{(pid=107262) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 13 02:27:22.083082 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.quota [None req-10c6d6d0-b0d0-4fec-a2e9-cf6a1f92485e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Getting quotas for user 1d3696355aae4727ae610990c9efb5eb and project 197b525e7a104e5ebcd262a734055741. Resources: {'ram', 'cores', 'instances'} {{(pid=107262) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 13 02:27:22.103240 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-10c6d6d0-b0d0-4fec-a2e9-cf6a1f92485e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Going to run 1 instances... {{(pid=107262) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 13 02:27:22.106347 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-10c6d6d0-b0d0-4fec-a2e9-cf6a1f92485e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a3efd47-3618-4abd-b00b-a9fa9b90b4d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107262) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 13 02:27:22.115943 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-709a6c1d-17cc-4ee7-ab07-809f3d03cefe tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Flavor limits 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 02:27:22.116449 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-709a6c1d-17cc-4ee7-ab07-809f3d03cefe tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Image limits 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 02:27:22.117665 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-709a6c1d-17cc-4ee7-ab07-809f3d03cefe tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Flavor pref 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 02:27:22.118348 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-709a6c1d-17cc-4ee7-ab07-809f3d03cefe tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Image pref 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 02:27:22.118840 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-709a6c1d-17cc-4ee7-ab07-809f3d03cefe tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 02:27:22.128346 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2690: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:22.128346 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: user_quotas = model_query(context, models.ProjectUserQuota, Jul 13 02:27:22.133186 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-709a6c1d-17cc-4ee7-ab07-809f3d03cefe tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:22.133867 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-709a6c1d-17cc-4ee7-ab07-809f3d03cefe tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:22.135056 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-709a6c1d-17cc-4ee7-ab07-809f3d03cefe tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:22.135659 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-709a6c1d-17cc-4ee7-ab07-809f3d03cefe tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:22.141310 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/objects/instance.py:1537: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:22.141310 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: project_result = project_query.first() Jul 13 02:27:22.154774 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2708: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:22.154774 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: rows = model_query(context, models.Quota, read_deleted="no").\ Jul 13 02:27:22.158390 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.quota [None req-709a6c1d-17cc-4ee7-ab07-809f3d03cefe tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Getting quotas for project cc0ee8f5f4bc44599b259e826174d9ae. Resources: {'ram', 'cores', 'instances'} {{(pid=107263) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 13 02:27:22.162183 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.quota [None req-709a6c1d-17cc-4ee7-ab07-809f3d03cefe tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Getting quotas for user c7b72418c3974756b604d0acb2c8188b and project cc0ee8f5f4bc44599b259e826174d9ae. Resources: {'ram', 'cores', 'instances'} {{(pid=107263) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 13 02:27:22.166428 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-10c6d6d0-b0d0-4fec-a2e9-cf6a1f92485e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.249552 Jul 13 02:27:22.167655 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 19/33] 10.222.0.32 () {60 vars in 1147 bytes} [Tue Jul 13 02:27:19 2021] POST /compute/v2.1/servers => generated 402 bytes in 2251 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 02:27:22.172884 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-f9a5d500-8778-4939-9232-c4f4d77ba2d6 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:22.173726 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-f9a5d500-8778-4939-9232-c4f4d77ba2d6 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] [instance: cdd6e2b3-3294-448d-b390-4340eb1cf4fe] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:22.180219 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-709a6c1d-17cc-4ee7-ab07-809f3d03cefe tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Going to run 1 instances... {{(pid=107263) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 13 02:27:22.180607 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f9a5d500-8778-4939-9232-c4f4d77ba2d6 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:22.181308 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f9a5d500-8778-4939-9232-c4f4d77ba2d6 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:22.182325 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f9a5d500-8778-4939-9232-c4f4d77ba2d6 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:22.182488 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-709a6c1d-17cc-4ee7-ab07-809f3d03cefe tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a3efd47-3618-4abd-b00b-a9fa9b90b4d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 13 02:27:22.182769 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f9a5d500-8778-4939-9232-c4f4d77ba2d6 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:22.185883 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:22.185883 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:22.236488 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-709a6c1d-17cc-4ee7-ab07-809f3d03cefe tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.233589 Jul 13 02:27:22.237366 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 15/34] 10.222.0.32 () {60 vars in 1147 bytes} [Tue Jul 13 02:27:21 2021] POST /compute/v2.1/servers => generated 383 bytes in 1235 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 02:27:22.250428 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-d269e04b-6b68-4b9a-9423-be2a2b738feb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1025589458", "imageRef": "1a3efd47-3618-4abd-b00b-a9fa9b90b4d4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4baa4fb6-de8b-4124-9674-6f3872d23a0f"}], "security_groups": [{"name": "tempest-securitygroup--1044535158"}], "key_name": "tempest-keypair-1055037345", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:27:22.377276 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.network.neutron [None req-d269e04b-6b68-4b9a-9423-be2a2b738feb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] validate_networks() for [('4baa4fb6-de8b-4124-9674-6f3872d23a0f', None, None, None)] {{(pid=107263) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Jul 13 02:27:22.513333 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-f9a5d500-8778-4939-9232-c4f4d77ba2d6 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd9c7709a68475abdb5aba9f475b865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b02533417754144803237804ba3c72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:22.520020 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:22.520020 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:22.532280 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-f9a5d500-8778-4939-9232-c4f4d77ba2d6 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] 10.222.0.32 "GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe" status: 200 len: 1315 microversion: 2.1 time: 0.363269 Jul 13 02:27:22.533804 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 20/35] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:22 2021] GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe => generated 1315 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:22.539716 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-6865d59a-03a3-4f82-a4d9-d61c55772094 req-8d3ebf37-7d45-458a-85e3-19f2dab7cbc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7423adc-bb73-46e2-8ddf-203316b7094a", "tag": "169b5bff-c716-4a28-9ed0-c59c69e1f08b"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:27:22.542099 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:27:22.542099 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:27:22.557738 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-6865d59a-03a3-4f82-a4d9-d61c55772094 req-8d3ebf37-7d45-458a-85e3-19f2dab7cbc0 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:22.558273 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-6865d59a-03a3-4f82-a4d9-d61c55772094 req-8d3ebf37-7d45-458a-85e3-19f2dab7cbc0 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:22.572846 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-6865d59a-03a3-4f82-a4d9-d61c55772094 req-8d3ebf37-7d45-458a-85e3-19f2dab7cbc0 service nova] Creating event network-changed:169b5bff-c716-4a28-9ed0-c59c69e1f08b for instance d7423adc-bb73-46e2-8ddf-203316b7094a on hv-cinder-78102 Jul 13 02:27:22.578504 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-6865d59a-03a3-4f82-a4d9-d61c55772094 req-8d3ebf37-7d45-458a-85e3-19f2dab7cbc0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043032 Jul 13 02:27:22.579255 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 21/36] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:27:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:27:22.585437 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-786d76cc-62fe-4321-9202-3fbe37ff68c9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:22.586844 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-786d76cc-62fe-4321-9202-3fbe37ff68c9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d7423adc-bb73-46e2-8ddf-203316b7094a] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:22.594878 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-786d76cc-62fe-4321-9202-3fbe37ff68c9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:22.595680 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-786d76cc-62fe-4321-9202-3fbe37ff68c9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:22.597065 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-786d76cc-62fe-4321-9202-3fbe37ff68c9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:22.598301 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-786d76cc-62fe-4321-9202-3fbe37ff68c9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:22.603480 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:22.603480 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:23.062180 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-786d76cc-62fe-4321-9202-3fbe37ff68c9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:23.066193 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:23.066193 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:23.075419 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-786d76cc-62fe-4321-9202-3fbe37ff68c9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a" status: 200 len: 1318 microversion: 2.1 time: 0.494700 Jul 13 02:27:23.076002 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 22/37] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:22 2021] GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a => generated 1318 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:23.086384 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-d269e04b-6b68-4b9a-9423-be2a2b738feb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Flavor limits 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 02:27:23.086888 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-d269e04b-6b68-4b9a-9423-be2a2b738feb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Image limits 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 02:27:23.087590 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-d269e04b-6b68-4b9a-9423-be2a2b738feb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Flavor pref 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 02:27:23.088061 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-d269e04b-6b68-4b9a-9423-be2a2b738feb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Image pref 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 02:27:23.088670 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-d269e04b-6b68-4b9a-9423-be2a2b738feb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 02:27:23.089903 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-e32c9c61-da59-44da-8f1c-e623abcda65f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:23.090548 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-e32c9c61-da59-44da-8f1c-e623abcda65f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:23.095367 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2690: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:23.095367 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: user_quotas = model_query(context, models.ProjectUserQuota, Jul 13 02:27:23.098976 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d269e04b-6b68-4b9a-9423-be2a2b738feb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:23.099491 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d269e04b-6b68-4b9a-9423-be2a2b738feb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:23.099726 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e32c9c61-da59-44da-8f1c-e623abcda65f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:23.100185 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e32c9c61-da59-44da-8f1c-e623abcda65f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:23.100357 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d269e04b-6b68-4b9a-9423-be2a2b738feb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:23.100749 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d269e04b-6b68-4b9a-9423-be2a2b738feb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:23.100976 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e32c9c61-da59-44da-8f1c-e623abcda65f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:23.102239 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e32c9c61-da59-44da-8f1c-e623abcda65f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:23.105217 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:23.105217 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:23.107084 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/objects/instance.py:1537: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:23.107084 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: project_result = project_query.first() Jul 13 02:27:23.120417 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2708: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:23.120417 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: rows = model_query(context, models.Quota, read_deleted="no").\ Jul 13 02:27:23.124966 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.quota [None req-d269e04b-6b68-4b9a-9423-be2a2b738feb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Getting quotas for project 63a044a9d95c49ce9281f67e741cf8ad. Resources: {'ram', 'cores', 'instances'} {{(pid=107263) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 13 02:27:23.135778 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.quota [None req-d269e04b-6b68-4b9a-9423-be2a2b738feb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Getting quotas for user a5fff5f367864fbb9a8731f6dfbc4d62 and project 63a044a9d95c49ce9281f67e741cf8ad. Resources: {'ram', 'cores', 'instances'} {{(pid=107263) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 13 02:27:23.145343 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-d269e04b-6b68-4b9a-9423-be2a2b738feb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Going to run 1 instances... {{(pid=107263) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 13 02:27:23.147584 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-d269e04b-6b68-4b9a-9423-be2a2b738feb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a3efd47-3618-4abd-b00b-a9fa9b90b4d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 13 02:27:23.199560 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-d269e04b-6b68-4b9a-9423-be2a2b738feb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.960202 Jul 13 02:27:23.211658 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 16/38] 10.222.0.32 () {62 vars in 1188 bytes} [Tue Jul 13 02:27:22 2021] POST /compute/v2.1/servers => generated 402 bytes in 971 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 13 02:27:23.218523 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-43231c4f-9770-4066-a0da-fbb3295ec58b tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:23.219067 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-43231c4f-9770-4066-a0da-fbb3295ec58b tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:23.225993 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-43231c4f-9770-4066-a0da-fbb3295ec58b tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:23.226633 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-43231c4f-9770-4066-a0da-fbb3295ec58b tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:23.227456 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-43231c4f-9770-4066-a0da-fbb3295ec58b tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:23.227897 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-43231c4f-9770-4066-a0da-fbb3295ec58b tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:23.231371 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:23.231371 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:23.237113 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-e32c9c61-da59-44da-8f1c-e623abcda65f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:23.239764 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:23.239764 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:23.248067 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-e32c9c61-da59-44da-8f1c-e623abcda65f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1242 microversion: 2.1 time: 0.161852 Jul 13 02:27:23.248915 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 23/39] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:23 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1242 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:23.253458 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-a142d384-3d22-456a-8e87-2263fe709b17 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:23.254332 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-a142d384-3d22-456a-8e87-2263fe709b17 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:23.315855 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-a142d384-3d22-456a-8e87-2263fe709b17 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:23.322848 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:23.322848 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:23.330369 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-a142d384-3d22-456a-8e87-2263fe709b17 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:23.332425 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-a142d384-3d22-456a-8e87-2263fe709b17 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:23.334551 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-a142d384-3d22-456a-8e87-2263fe709b17 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1282 microversion: 2.20 time: 0.084198 Jul 13 02:27:23.335675 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 24/40] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:27:23 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1282 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:27:23.350698 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-43231c4f-9770-4066-a0da-fbb3295ec58b tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:23.353533 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:23.353533 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:23.362941 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-43231c4f-9770-4066-a0da-fbb3295ec58b tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1225 microversion: 2.1 time: 0.149422 Jul 13 02:27:23.363672 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 17/41] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:23 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1225 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:23.548402 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-52f9ccba-4d53-4ee3-8ed4-e51a25a2ae3b tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:23.549021 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-52f9ccba-4d53-4ee3-8ed4-e51a25a2ae3b tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] [instance: cdd6e2b3-3294-448d-b390-4340eb1cf4fe] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:23.554853 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-52f9ccba-4d53-4ee3-8ed4-e51a25a2ae3b tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:23.555370 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-52f9ccba-4d53-4ee3-8ed4-e51a25a2ae3b tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:23.556176 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-52f9ccba-4d53-4ee3-8ed4-e51a25a2ae3b tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:23.556619 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-52f9ccba-4d53-4ee3-8ed4-e51a25a2ae3b tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:23.559806 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:23.559806 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:23.733240 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-52f9ccba-4d53-4ee3-8ed4-e51a25a2ae3b tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd9c7709a68475abdb5aba9f475b865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b02533417754144803237804ba3c72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:23.735811 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:23.735811 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:23.742800 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-52f9ccba-4d53-4ee3-8ed4-e51a25a2ae3b tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] 10.222.0.32 "GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe" status: 200 len: 1315 microversion: 2.1 time: 0.198070 Jul 13 02:27:23.743379 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 25/42] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:23 2021] GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:24.092335 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-c84f6d3c-9f44-4e14-ba3c-e3d5eb71de7d tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:24.092944 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-c84f6d3c-9f44-4e14-ba3c-e3d5eb71de7d tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d7423adc-bb73-46e2-8ddf-203316b7094a] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:24.098785 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c84f6d3c-9f44-4e14-ba3c-e3d5eb71de7d tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:24.099229 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c84f6d3c-9f44-4e14-ba3c-e3d5eb71de7d tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:24.100114 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c84f6d3c-9f44-4e14-ba3c-e3d5eb71de7d tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:24.100538 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c84f6d3c-9f44-4e14-ba3c-e3d5eb71de7d tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:24.103671 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:24.103671 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:24.264772 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-dc247e88-8962-47f4-a3cd-fe8068851d57 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:24.265307 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-dc247e88-8962-47f4-a3cd-fe8068851d57 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:24.270998 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-dc247e88-8962-47f4-a3cd-fe8068851d57 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:24.271439 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-dc247e88-8962-47f4-a3cd-fe8068851d57 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:24.272194 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-dc247e88-8962-47f4-a3cd-fe8068851d57 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:24.272621 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-dc247e88-8962-47f4-a3cd-fe8068851d57 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:24.275744 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:24.275744 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:24.280141 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-c84f6d3c-9f44-4e14-ba3c-e3d5eb71de7d tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:24.282734 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:24.282734 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:24.291202 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-c84f6d3c-9f44-4e14-ba3c-e3d5eb71de7d tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a" status: 200 len: 1318 microversion: 2.1 time: 0.202513 Jul 13 02:27:24.291806 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 18/43] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:24 2021] GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:27:24.353303 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-9c1e4364-6d6d-4095-ad92-49e732369df6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:24.354209 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-9c1e4364-6d6d-4095-ad92-49e732369df6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:24.360237 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-9c1e4364-6d6d-4095-ad92-49e732369df6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:24.360762 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-9c1e4364-6d6d-4095-ad92-49e732369df6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:24.361661 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-9c1e4364-6d6d-4095-ad92-49e732369df6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:24.362382 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-9c1e4364-6d6d-4095-ad92-49e732369df6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:24.365830 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:24.365830 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:24.378565 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-dc247e88-8962-47f4-a3cd-fe8068851d57 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:24.381255 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:24.381255 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:24.389776 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-dc247e88-8962-47f4-a3cd-fe8068851d57 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1242 microversion: 2.1 time: 0.128908 Jul 13 02:27:24.390526 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 26/44] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:24 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1242 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:27:24.395214 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-36e59cd2-3cf8-4fee-842e-0f892a86b0e0 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:24.395814 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-36e59cd2-3cf8-4fee-842e-0f892a86b0e0 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:24.402156 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-36e59cd2-3cf8-4fee-842e-0f892a86b0e0 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:24.402890 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-36e59cd2-3cf8-4fee-842e-0f892a86b0e0 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:24.404027 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-36e59cd2-3cf8-4fee-842e-0f892a86b0e0 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:24.404888 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-36e59cd2-3cf8-4fee-842e-0f892a86b0e0 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:24.408301 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:24.408301 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:24.496561 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-9c1e4364-6d6d-4095-ad92-49e732369df6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:24.500145 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:24.500145 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:24.520580 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-9c1e4364-6d6d-4095-ad92-49e732369df6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:24.525899 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-9c1e4364-6d6d-4095-ad92-49e732369df6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:24.531437 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-9c1e4364-6d6d-4095-ad92-49e732369df6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1286 microversion: 2.20 time: 0.182353 Jul 13 02:27:24.537108 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 19/45] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:27:24 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1286 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:27:24.658443 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-36e59cd2-3cf8-4fee-842e-0f892a86b0e0 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:24.661562 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:24.661562 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:24.676602 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-36e59cd2-3cf8-4fee-842e-0f892a86b0e0 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1225 microversion: 2.1 time: 0.284783 Jul 13 02:27:24.677968 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 27/46] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:24 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1225 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:24.760366 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-fc56f200-dc41-4bad-84f2-b4bc84b7bf34 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:24.761624 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-fc56f200-dc41-4bad-84f2-b4bc84b7bf34 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] [instance: cdd6e2b3-3294-448d-b390-4340eb1cf4fe] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:24.772506 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-fc56f200-dc41-4bad-84f2-b4bc84b7bf34 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:24.774193 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-fc56f200-dc41-4bad-84f2-b4bc84b7bf34 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:24.775856 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-fc56f200-dc41-4bad-84f2-b4bc84b7bf34 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:24.776464 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-fc56f200-dc41-4bad-84f2-b4bc84b7bf34 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:24.780867 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:24.780867 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:25.131450 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-fc56f200-dc41-4bad-84f2-b4bc84b7bf34 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd9c7709a68475abdb5aba9f475b865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b02533417754144803237804ba3c72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:25.136123 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:25.136123 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:25.145200 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-fc56f200-dc41-4bad-84f2-b4bc84b7bf34 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] 10.222.0.32 "GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe" status: 200 len: 1315 microversion: 2.1 time: 0.389050 Jul 13 02:27:25.146427 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 20/47] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:24 2021] GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe => generated 1315 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:25.308227 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-bf831639-5b1f-4d1a-923e-38c6e0f2d0c9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:25.309590 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-bf831639-5b1f-4d1a-923e-38c6e0f2d0c9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d7423adc-bb73-46e2-8ddf-203316b7094a] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:25.316702 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-bf831639-5b1f-4d1a-923e-38c6e0f2d0c9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:25.317601 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-bf831639-5b1f-4d1a-923e-38c6e0f2d0c9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:25.318740 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-bf831639-5b1f-4d1a-923e-38c6e0f2d0c9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:25.319390 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-bf831639-5b1f-4d1a-923e-38c6e0f2d0c9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:25.323699 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:25.323699 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:25.408315 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-a277fa91-a18e-4501-b513-96da45064809 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:25.409142 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-a277fa91-a18e-4501-b513-96da45064809 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:25.418743 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a277fa91-a18e-4501-b513-96da45064809 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:25.419203 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a277fa91-a18e-4501-b513-96da45064809 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:25.420047 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a277fa91-a18e-4501-b513-96da45064809 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:25.420639 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a277fa91-a18e-4501-b513-96da45064809 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:25.424011 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:25.424011 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:25.551221 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-a277fa91-a18e-4501-b513-96da45064809 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:25.553839 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:25.553839 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:25.558886 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-bf831639-5b1f-4d1a-923e-38c6e0f2d0c9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:25.561730 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:25.561730 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:25.564084 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-a277fa91-a18e-4501-b513-96da45064809 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1290 microversion: 2.1 time: 0.160996 Jul 13 02:27:25.564668 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 21/48] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:25 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1290 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:27:25.568858 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-bf831639-5b1f-4d1a-923e-38c6e0f2d0c9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a" status: 200 len: 1318 microversion: 2.1 time: 0.264595 Jul 13 02:27:25.569981 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 28/49] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:25 2021] GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:25.570451 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-4224b868-18a3-4e38-a61e-c238b1c1a988 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:25.571065 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-4224b868-18a3-4e38-a61e-c238b1c1a988 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:25.577088 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4224b868-18a3-4e38-a61e-c238b1c1a988 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:25.577875 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4224b868-18a3-4e38-a61e-c238b1c1a988 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:25.578858 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4224b868-18a3-4e38-a61e-c238b1c1a988 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:25.579294 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4224b868-18a3-4e38-a61e-c238b1c1a988 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:25.582193 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:25.582193 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:25.690330 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-4224b868-18a3-4e38-a61e-c238b1c1a988 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:25.692593 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:25.692593 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:25.693862 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-7b134c6b-4bf5-4a88-bd12-07279d2e02e2 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:25.694513 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-7b134c6b-4bf5-4a88-bd12-07279d2e02e2 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:25.700432 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7b134c6b-4bf5-4a88-bd12-07279d2e02e2 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:25.700882 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7b134c6b-4bf5-4a88-bd12-07279d2e02e2 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:25.701105 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-4224b868-18a3-4e38-a61e-c238b1c1a988 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:25.701658 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7b134c6b-4bf5-4a88-bd12-07279d2e02e2 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:25.702125 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7b134c6b-4bf5-4a88-bd12-07279d2e02e2 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:25.702641 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-4224b868-18a3-4e38-a61e-c238b1c1a988 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:25.703760 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-4224b868-18a3-4e38-a61e-c238b1c1a988 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1278 microversion: 2.20 time: 0.137446 Jul 13 02:27:25.704504 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 22/50] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:27:25 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1278 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:27:25.705103 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:25.705103 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:25.812706 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-7b134c6b-4bf5-4a88-bd12-07279d2e02e2 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:25.815304 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:25.815304 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:25.824910 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-7b134c6b-4bf5-4a88-bd12-07279d2e02e2 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1217 microversion: 2.1 time: 0.134515 Jul 13 02:27:25.825720 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 29/51] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:25 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1217 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:27:26.162989 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-9d9c6239-2c08-4ce5-b732-d353cca55162 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:26.163607 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-9d9c6239-2c08-4ce5-b732-d353cca55162 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] [instance: cdd6e2b3-3294-448d-b390-4340eb1cf4fe] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:26.169388 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-9d9c6239-2c08-4ce5-b732-d353cca55162 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:26.169833 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-9d9c6239-2c08-4ce5-b732-d353cca55162 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:26.170636 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-9d9c6239-2c08-4ce5-b732-d353cca55162 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:26.171075 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-9d9c6239-2c08-4ce5-b732-d353cca55162 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:26.173898 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:26.173898 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:26.348345 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-9d9c6239-2c08-4ce5-b732-d353cca55162 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd9c7709a68475abdb5aba9f475b865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b02533417754144803237804ba3c72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:26.350996 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:26.350996 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:26.358934 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-9d9c6239-2c08-4ce5-b732-d353cca55162 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] 10.222.0.32 "GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe" status: 200 len: 1315 microversion: 2.1 time: 0.199703 Jul 13 02:27:26.359515 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 23/52] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:26 2021] GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:26.584969 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-dd5e84c7-408d-43ec-a349-1aabad863ece tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:26.585723 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-dd5e84c7-408d-43ec-a349-1aabad863ece tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:26.586461 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-955efdb3-5afb-449b-a6c9-e93d4aa32f6e tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:26.587745 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-955efdb3-5afb-449b-a6c9-e93d4aa32f6e tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d7423adc-bb73-46e2-8ddf-203316b7094a] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:26.592130 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-dd5e84c7-408d-43ec-a349-1aabad863ece tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:26.592572 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-dd5e84c7-408d-43ec-a349-1aabad863ece tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:26.593333 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-dd5e84c7-408d-43ec-a349-1aabad863ece tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:26.593760 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-dd5e84c7-408d-43ec-a349-1aabad863ece tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:26.595680 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-955efdb3-5afb-449b-a6c9-e93d4aa32f6e tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:26.596411 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-955efdb3-5afb-449b-a6c9-e93d4aa32f6e tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:26.596644 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:26.596644 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:26.597662 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-955efdb3-5afb-449b-a6c9-e93d4aa32f6e tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:26.598446 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-955efdb3-5afb-449b-a6c9-e93d4aa32f6e tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:26.602233 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:26.602233 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:26.711319 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-dd5e84c7-408d-43ec-a349-1aabad863ece tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:26.713910 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:26.713910 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:26.722088 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-dd5e84c7-408d-43ec-a349-1aabad863ece tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1290 microversion: 2.1 time: 0.140993 Jul 13 02:27:26.722747 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 30/53] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:26 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1290 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:26.730365 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-3604d881-e3c8-4001-a11e-00ad670dfb85 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:26.730988 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-3604d881-e3c8-4001-a11e-00ad670dfb85 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:26.737362 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3604d881-e3c8-4001-a11e-00ad670dfb85 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:26.737811 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3604d881-e3c8-4001-a11e-00ad670dfb85 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:26.738622 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3604d881-e3c8-4001-a11e-00ad670dfb85 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:26.739060 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3604d881-e3c8-4001-a11e-00ad670dfb85 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:26.742951 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:26.742951 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:26.808375 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-955efdb3-5afb-449b-a6c9-e93d4aa32f6e tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:26.811024 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:26.811024 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:26.817871 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-955efdb3-5afb-449b-a6c9-e93d4aa32f6e tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a" status: 200 len: 1318 microversion: 2.1 time: 0.235568 Jul 13 02:27:26.818475 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 24/54] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:26 2021] GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:27:26.844409 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-d3863cef-2a60-4d91-b900-11f16ebb2037 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:26.845014 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-d3863cef-2a60-4d91-b900-11f16ebb2037 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:26.851704 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d3863cef-2a60-4d91-b900-11f16ebb2037 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:26.852145 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d3863cef-2a60-4d91-b900-11f16ebb2037 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:26.852900 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d3863cef-2a60-4d91-b900-11f16ebb2037 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:26.853414 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d3863cef-2a60-4d91-b900-11f16ebb2037 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:26.856248 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:26.856248 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:26.862429 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-3604d881-e3c8-4001-a11e-00ad670dfb85 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:26.864948 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:26.864948 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:26.873098 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-3604d881-e3c8-4001-a11e-00ad670dfb85 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:26.874720 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-3604d881-e3c8-4001-a11e-00ad670dfb85 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:26.875719 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-3604d881-e3c8-4001-a11e-00ad670dfb85 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1278 microversion: 2.20 time: 0.151999 Jul 13 02:27:26.876272 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 31/55] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:27:26 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1278 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:27:26.959556 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-d3863cef-2a60-4d91-b900-11f16ebb2037 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:26.962904 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:26.962904 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:26.969623 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-d3863cef-2a60-4d91-b900-11f16ebb2037 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1217 microversion: 2.1 time: 0.129105 Jul 13 02:27:26.970430 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 25/56] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:26 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1217 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:27:27.376524 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-ecdcdec7-9d97-4fe3-bb8b-ccf719886678 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:27.377132 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-ecdcdec7-9d97-4fe3-bb8b-ccf719886678 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] [instance: cdd6e2b3-3294-448d-b390-4340eb1cf4fe] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:27.383803 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ecdcdec7-9d97-4fe3-bb8b-ccf719886678 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:27.384246 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ecdcdec7-9d97-4fe3-bb8b-ccf719886678 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:27.385001 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ecdcdec7-9d97-4fe3-bb8b-ccf719886678 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:27.385428 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ecdcdec7-9d97-4fe3-bb8b-ccf719886678 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:27.388460 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:27.388460 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:27.573606 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-ecdcdec7-9d97-4fe3-bb8b-ccf719886678 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd9c7709a68475abdb5aba9f475b865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b02533417754144803237804ba3c72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:27.576517 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:27.576517 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:27.583575 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-ecdcdec7-9d97-4fe3-bb8b-ccf719886678 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] 10.222.0.32 "GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe" status: 200 len: 1315 microversion: 2.1 time: 0.210677 Jul 13 02:27:27.584144 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 32/57] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:27 2021] GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:27.743476 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-11eb06c8-b4f5-4e11-8b62-8b88a75e04f6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:27.744121 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-11eb06c8-b4f5-4e11-8b62-8b88a75e04f6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:27.749739 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-11eb06c8-b4f5-4e11-8b62-8b88a75e04f6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:27.750231 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-11eb06c8-b4f5-4e11-8b62-8b88a75e04f6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:27.750992 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-11eb06c8-b4f5-4e11-8b62-8b88a75e04f6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:27.751427 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-11eb06c8-b4f5-4e11-8b62-8b88a75e04f6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:27.754241 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:27.754241 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:27.838158 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-071c603e-5c41-4194-8427-b68d0a413e7d tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:27.839241 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-071c603e-5c41-4194-8427-b68d0a413e7d tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d7423adc-bb73-46e2-8ddf-203316b7094a] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:27.848562 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-071c603e-5c41-4194-8427-b68d0a413e7d tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:27.849825 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-071c603e-5c41-4194-8427-b68d0a413e7d tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:27.850851 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-071c603e-5c41-4194-8427-b68d0a413e7d tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:27.852728 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-071c603e-5c41-4194-8427-b68d0a413e7d tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:27.857473 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:27.857473 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:27.879235 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-11eb06c8-b4f5-4e11-8b62-8b88a75e04f6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:27.882811 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:27.882811 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:27.893487 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-11eb06c8-b4f5-4e11-8b62-8b88a75e04f6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1290 microversion: 2.1 time: 0.153351 Jul 13 02:27:27.904194 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 26/58] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:27 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1290 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:27.915916 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-774f2d6d-2506-4c65-ad62-0c70b5bf64a7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:27.916938 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-774f2d6d-2506-4c65-ad62-0c70b5bf64a7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:27.933101 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-774f2d6d-2506-4c65-ad62-0c70b5bf64a7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:27.933908 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-774f2d6d-2506-4c65-ad62-0c70b5bf64a7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:27.935621 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-774f2d6d-2506-4c65-ad62-0c70b5bf64a7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:27.937465 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-774f2d6d-2506-4c65-ad62-0c70b5bf64a7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:27.944655 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:27.944655 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:28.162399 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-774f2d6d-2506-4c65-ad62-0c70b5bf64a7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:28.165484 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:28.165484 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:28.175115 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-774f2d6d-2506-4c65-ad62-0c70b5bf64a7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:28.177946 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-774f2d6d-2506-4c65-ad62-0c70b5bf64a7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:28.179507 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-774f2d6d-2506-4c65-ad62-0c70b5bf64a7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1278 microversion: 2.20 time: 0.273787 Jul 13 02:27:28.193919 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 27/59] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:27:27 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1278 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:27:28.200243 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-2a202042-729d-4159-ac1f-5d9843d110d6 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:28.201302 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-2a202042-729d-4159-ac1f-5d9843d110d6 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:28.207572 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2a202042-729d-4159-ac1f-5d9843d110d6 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:28.208454 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2a202042-729d-4159-ac1f-5d9843d110d6 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:28.209448 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2a202042-729d-4159-ac1f-5d9843d110d6 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:28.210442 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2a202042-729d-4159-ac1f-5d9843d110d6 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:28.214582 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:28.214582 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:28.313907 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-071c603e-5c41-4194-8427-b68d0a413e7d tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:28.316541 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:28.316541 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:28.330220 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-071c603e-5c41-4194-8427-b68d0a413e7d tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a" status: 200 len: 1318 microversion: 2.1 time: 0.494373 Jul 13 02:27:28.333187 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 33/60] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:27 2021] GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a => generated 1318 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:27:28.474506 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-2a202042-729d-4159-ac1f-5d9843d110d6 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:28.478524 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:28.478524 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:28.489538 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-2a202042-729d-4159-ac1f-5d9843d110d6 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1273 microversion: 2.1 time: 0.293601 Jul 13 02:27:28.490156 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 28/61] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:28 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1273 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:28.605068 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-6c007623-7bc9-4654-bff4-83e83160ea7c tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:28.606115 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-6c007623-7bc9-4654-bff4-83e83160ea7c tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] [instance: cdd6e2b3-3294-448d-b390-4340eb1cf4fe] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:28.626874 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-6c007623-7bc9-4654-bff4-83e83160ea7c tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:28.630244 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-6c007623-7bc9-4654-bff4-83e83160ea7c tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:28.631299 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-6c007623-7bc9-4654-bff4-83e83160ea7c tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:28.631902 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-6c007623-7bc9-4654-bff4-83e83160ea7c tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:28.642769 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:28.642769 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:28.915879 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-8de44423-e9c8-4456-b624-3103925d2a99 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:28.919280 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-8de44423-e9c8-4456-b624-3103925d2a99 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:28.947765 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8de44423-e9c8-4456-b624-3103925d2a99 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:28.948939 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8de44423-e9c8-4456-b624-3103925d2a99 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:28.950095 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8de44423-e9c8-4456-b624-3103925d2a99 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:28.951145 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8de44423-e9c8-4456-b624-3103925d2a99 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:28.963789 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:28.963789 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:29.287730 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-8de44423-e9c8-4456-b624-3103925d2a99 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:29.299469 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:29.299469 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:29.316952 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-8de44423-e9c8-4456-b624-3103925d2a99 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1296 microversion: 2.1 time: 0.406794 Jul 13 02:27:29.317727 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 29/62] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:28 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1296 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:29.329480 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-7ad2414e-5334-4fed-8119-3c2c5b3afe9b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:29.331260 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-7ad2414e-5334-4fed-8119-3c2c5b3afe9b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:29.352614 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7ad2414e-5334-4fed-8119-3c2c5b3afe9b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:29.353062 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7ad2414e-5334-4fed-8119-3c2c5b3afe9b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:29.355714 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7ad2414e-5334-4fed-8119-3c2c5b3afe9b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:29.356162 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7ad2414e-5334-4fed-8119-3c2c5b3afe9b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:29.363880 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:29.363880 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:29.467759 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-6c007623-7bc9-4654-bff4-83e83160ea7c tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd9c7709a68475abdb5aba9f475b865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b02533417754144803237804ba3c72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:29.470352 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:29.470352 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:29.478552 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-6c007623-7bc9-4654-bff4-83e83160ea7c tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] 10.222.0.32 "GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe" status: 200 len: 1315 microversion: 2.1 time: 0.880949 Jul 13 02:27:29.479694 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 34/63] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:28 2021] GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe => generated 1315 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:29.484666 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-31d2403e-3386-436b-8407-0679b1b98619 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:29.485935 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-31d2403e-3386-436b-8407-0679b1b98619 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d7423adc-bb73-46e2-8ddf-203316b7094a] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:29.496364 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-31d2403e-3386-436b-8407-0679b1b98619 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:29.497363 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-31d2403e-3386-436b-8407-0679b1b98619 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:29.498405 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-31d2403e-3386-436b-8407-0679b1b98619 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:29.499197 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-31d2403e-3386-436b-8407-0679b1b98619 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:29.503027 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:29.503027 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:29.619375 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-7ad2414e-5334-4fed-8119-3c2c5b3afe9b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:29.623065 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:29.623065 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:29.639212 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-7ad2414e-5334-4fed-8119-3c2c5b3afe9b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:29.641227 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-7ad2414e-5334-4fed-8119-3c2c5b3afe9b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:29.642368 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-7ad2414e-5334-4fed-8119-3c2c5b3afe9b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1342 microversion: 2.20 time: 0.322805 Jul 13 02:27:29.643170 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 30/64] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:27:29 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1342 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:27:29.647827 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-df3d14d5-dcbd-4dc2-a857-303e0bd6db24 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:29.648657 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-df3d14d5-dcbd-4dc2-a857-303e0bd6db24 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:29.657068 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-df3d14d5-dcbd-4dc2-a857-303e0bd6db24 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:29.657978 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-df3d14d5-dcbd-4dc2-a857-303e0bd6db24 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:29.658816 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-df3d14d5-dcbd-4dc2-a857-303e0bd6db24 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:29.659243 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-df3d14d5-dcbd-4dc2-a857-303e0bd6db24 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:29.664821 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:29.664821 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:29.860332 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-df3d14d5-dcbd-4dc2-a857-303e0bd6db24 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:29.863601 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:29.863601 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:29.871531 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-df3d14d5-dcbd-4dc2-a857-303e0bd6db24 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1279 microversion: 2.1 time: 0.227213 Jul 13 02:27:29.882133 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 31/65] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:29 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1279 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:29.887434 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [req-a9f48110-cf73-44ed-862a-6b34217a35ce req-07790e7d-24e4-4b54-981e-f3a0577869aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "163ad440-5d5c-420d-ab44-52f27c5e22dc", "tag": "b303b0dd-0f82-4db9-98d2-7bd04096a59a"}]} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:27:29.890112 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:27:29.890112 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: warnings.warn(msg) Jul 13 02:27:29.904229 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-a9f48110-cf73-44ed-862a-6b34217a35ce req-07790e7d-24e4-4b54-981e-f3a0577869aa service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:29.904367 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-a9f48110-cf73-44ed-862a-6b34217a35ce req-07790e7d-24e4-4b54-981e-f3a0577869aa service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:29.943137 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.compute.server_external_events [req-a9f48110-cf73-44ed-862a-6b34217a35ce req-07790e7d-24e4-4b54-981e-f3a0577869aa service nova] Creating event network-changed:b303b0dd-0f82-4db9-98d2-7bd04096a59a for instance 163ad440-5d5c-420d-ab44-52f27c5e22dc on hv-cinder-78102 Jul 13 02:27:29.943705 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-a9f48110-cf73-44ed-862a-6b34217a35ce req-07790e7d-24e4-4b54-981e-f3a0577869aa service nova] Acquired lock "compute-rpcapi-router" {{(pid=107263) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Jul 13 02:27:29.944745 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7bfd3dd4-957f-4f2a-a5e9-a587f737c933 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:29.945190 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7bfd3dd4-957f-4f2a-a5e9-a587f737c933 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:29.946122 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7bfd3dd4-957f-4f2a-a5e9-a587f737c933 None None] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:29.946741 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7bfd3dd4-957f-4f2a-a5e9-a587f737c933 None None] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:29.951514 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:439: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:29.951514 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return dict(min_versions) Jul 13 02:27:29.963066 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.compute.rpcapi [None req-7bfd3dd4-957f-4f2a-a5e9-a587f737c933 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Jul 13 02:27:29.964352 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7bfd3dd4-957f-4f2a-a5e9-a587f737c933 None None] Releasing lock "compute-rpcapi-router" {{(pid=107263) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Jul 13 02:27:30.002008 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-7bfd3dd4-957f-4f2a-a5e9-a587f737c933 None None] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118360 Jul 13 02:27:30.003686 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 32/66] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:27:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:27:30.129963 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-31d2403e-3386-436b-8407-0679b1b98619 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:30.133118 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:30.133118 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:30.151288 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-31d2403e-3386-436b-8407-0679b1b98619 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a" status: 200 len: 1318 microversion: 2.1 time: 0.670153 Jul 13 02:27:30.153560 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 35/67] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:29 2021] GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a => generated 1318 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:30.340857 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-daadc10d-6471-4c33-817e-a342da3846c6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:30.342166 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-daadc10d-6471-4c33-817e-a342da3846c6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:30.350718 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-daadc10d-6471-4c33-817e-a342da3846c6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:30.352609 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-daadc10d-6471-4c33-817e-a342da3846c6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:30.353648 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-daadc10d-6471-4c33-817e-a342da3846c6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:30.354320 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-daadc10d-6471-4c33-817e-a342da3846c6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:30.358337 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:30.358337 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:30.666311 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-2cc6cd76-d0e8-43be-916c-16060b285b2e req-34dbeac9-f121-4cb2-bf21-4914e4b43f8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7423adc-bb73-46e2-8ddf-203316b7094a", "name": "network-vif-plugged", "status": "completed", "tag": "169b5bff-c716-4a28-9ed0-c59c69e1f08b"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:27:30.668298 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:27:30.668298 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:27:30.689385 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-2cc6cd76-d0e8-43be-916c-16060b285b2e req-34dbeac9-f121-4cb2-bf21-4914e4b43f8b service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:30.689855 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-2cc6cd76-d0e8-43be-916c-16060b285b2e req-34dbeac9-f121-4cb2-bf21-4914e4b43f8b service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:30.727044 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-2cc6cd76-d0e8-43be-916c-16060b285b2e req-34dbeac9-f121-4cb2-bf21-4914e4b43f8b service nova] Creating event network-vif-plugged:169b5bff-c716-4a28-9ed0-c59c69e1f08b for instance d7423adc-bb73-46e2-8ddf-203316b7094a on hv-cinder-78102 Jul 13 02:27:30.738806 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-2cc6cd76-d0e8-43be-916c-16060b285b2e req-34dbeac9-f121-4cb2-bf21-4914e4b43f8b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.316943 Jul 13 02:27:30.741361 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 36/68] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:27:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:27:30.757016 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-b16faa4b-ea37-4be6-8520-e654ecdaaf0a tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:30.759646 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-b16faa4b-ea37-4be6-8520-e654ecdaaf0a tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] [instance: cdd6e2b3-3294-448d-b390-4340eb1cf4fe] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:30.775939 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b16faa4b-ea37-4be6-8520-e654ecdaaf0a tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:30.779021 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b16faa4b-ea37-4be6-8520-e654ecdaaf0a tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:30.780297 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b16faa4b-ea37-4be6-8520-e654ecdaaf0a tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:30.782914 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b16faa4b-ea37-4be6-8520-e654ecdaaf0a tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:30.791596 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:30.791596 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:31.246798 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-daadc10d-6471-4c33-817e-a342da3846c6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:31.250177 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:31.250177 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:31.259137 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-daadc10d-6471-4c33-817e-a342da3846c6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1364 microversion: 2.1 time: 0.924289 Jul 13 02:27:31.259726 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 33/69] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:30 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1364 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:31.264814 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-330942fe-9fbd-4f0c-aad3-c1048966afce tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:31.265669 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-330942fe-9fbd-4f0c-aad3-c1048966afce tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:31.273615 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-330942fe-9fbd-4f0c-aad3-c1048966afce tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:31.274078 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-330942fe-9fbd-4f0c-aad3-c1048966afce tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:31.275255 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-330942fe-9fbd-4f0c-aad3-c1048966afce tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:31.275536 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-330942fe-9fbd-4f0c-aad3-c1048966afce tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:31.279716 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:31.279716 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:31.462781 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-330942fe-9fbd-4f0c-aad3-c1048966afce tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:31.467903 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:31.467903 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:31.479358 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-330942fe-9fbd-4f0c-aad3-c1048966afce tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:31.482561 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-330942fe-9fbd-4f0c-aad3-c1048966afce tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:31.484958 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-330942fe-9fbd-4f0c-aad3-c1048966afce tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1340 microversion: 2.20 time: 0.223143 Jul 13 02:27:31.486948 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 34/70] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:27:31 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1340 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:27:31.492337 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-43d529b6-51ed-4287-905d-0f5fd37096ec tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:31.493440 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-43d529b6-51ed-4287-905d-0f5fd37096ec tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:31.500800 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-43d529b6-51ed-4287-905d-0f5fd37096ec tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:31.503055 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-43d529b6-51ed-4287-905d-0f5fd37096ec tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:31.504976 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-43d529b6-51ed-4287-905d-0f5fd37096ec tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:31.505617 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-43d529b6-51ed-4287-905d-0f5fd37096ec tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:31.514016 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:31.514016 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:31.550231 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-b16faa4b-ea37-4be6-8520-e654ecdaaf0a tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd9c7709a68475abdb5aba9f475b865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b02533417754144803237804ba3c72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:31.552923 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:31.552923 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:31.565443 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-b16faa4b-ea37-4be6-8520-e654ecdaaf0a tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] 10.222.0.32 "GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe" status: 200 len: 1315 microversion: 2.1 time: 0.821983 Jul 13 02:27:31.566233 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 37/71] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:30 2021] GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe => generated 1315 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:31.591530 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-1a66711e-a286-4759-84d3-e186b190b906 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:31.592155 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-1a66711e-a286-4759-84d3-e186b190b906 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d7423adc-bb73-46e2-8ddf-203316b7094a] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:31.609799 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1a66711e-a286-4759-84d3-e186b190b906 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:31.610280 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1a66711e-a286-4759-84d3-e186b190b906 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:31.611117 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1a66711e-a286-4759-84d3-e186b190b906 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:31.611604 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1a66711e-a286-4759-84d3-e186b190b906 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:31.616100 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:31.616100 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:32.321320 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-43d529b6-51ed-4287-905d-0f5fd37096ec tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:32.336593 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:32.336593 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:32.365030 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-1a66711e-a286-4759-84d3-e186b190b906 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:32.370004 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:32.370004 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:32.375554 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-43d529b6-51ed-4287-905d-0f5fd37096ec tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1321 microversion: 2.1 time: 0.887297 Jul 13 02:27:32.379696 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 35/72] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:31 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1321 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:32.391508 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-8857a746-8a36-47b4-a3da-f363ffd0f0d3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:32.391743 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-1a66711e-a286-4759-84d3-e186b190b906 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a" status: 200 len: 1318 microversion: 2.1 time: 0.804199 Jul 13 02:27:32.401377 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 38/73] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:31 2021] GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a => generated 1318 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:32.406702 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-8857a746-8a36-47b4-a3da-f363ffd0f0d3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:32.414968 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8857a746-8a36-47b4-a3da-f363ffd0f0d3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:32.415421 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8857a746-8a36-47b4-a3da-f363ffd0f0d3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:32.417503 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8857a746-8a36-47b4-a3da-f363ffd0f0d3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:32.417737 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8857a746-8a36-47b4-a3da-f363ffd0f0d3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:32.421570 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:32.421570 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:32.505193 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-ce4c79e8-6373-436e-bee0-7f8a81ec201a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:32.505784 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-ce4c79e8-6373-436e-bee0-7f8a81ec201a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:32.513478 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ce4c79e8-6373-436e-bee0-7f8a81ec201a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:32.513923 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ce4c79e8-6373-436e-bee0-7f8a81ec201a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:32.514723 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ce4c79e8-6373-436e-bee0-7f8a81ec201a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:32.515201 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ce4c79e8-6373-436e-bee0-7f8a81ec201a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:32.521072 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:32.521072 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:33.233835 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-8857a746-8a36-47b4-a3da-f363ffd0f0d3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:33.237086 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:33.237086 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:33.246259 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-8857a746-8a36-47b4-a3da-f363ffd0f0d3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1364 microversion: 2.1 time: 0.865108 Jul 13 02:27:33.246947 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 36/74] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:32 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1364 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:33.251586 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-95de35b9-c354-4f51-bb5f-bdd3eb5d4e17 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:33.252472 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-95de35b9-c354-4f51-bb5f-bdd3eb5d4e17 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] [instance: cdd6e2b3-3294-448d-b390-4340eb1cf4fe] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:33.262227 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-95de35b9-c354-4f51-bb5f-bdd3eb5d4e17 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:33.263115 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-95de35b9-c354-4f51-bb5f-bdd3eb5d4e17 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:33.264387 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-95de35b9-c354-4f51-bb5f-bdd3eb5d4e17 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:33.265024 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-95de35b9-c354-4f51-bb5f-bdd3eb5d4e17 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:33.268929 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:33.268929 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:33.277785 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-ce4c79e8-6373-436e-bee0-7f8a81ec201a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:33.280680 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:33.280680 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:33.291867 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-ce4c79e8-6373-436e-bee0-7f8a81ec201a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:33.293418 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-ce4c79e8-6373-436e-bee0-7f8a81ec201a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:33.294786 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-ce4c79e8-6373-436e-bee0-7f8a81ec201a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1408 microversion: 2.20 time: 0.793980 Jul 13 02:27:33.295423 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 39/75] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:27:32 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1408 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:27:33.301554 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-6c989593-f923-4778-8db0-2b299af57396 req-38866961-bb73-423f-9f54-fd331b4f602d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8f2132c-4b9b-4c53-81c5-29e734143042", "tag": "4d10eb36-dce1-4c00-9fa1-a89e70dddb17"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:27:33.303900 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:27:33.303900 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:27:33.313254 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-6c989593-f923-4778-8db0-2b299af57396 req-38866961-bb73-423f-9f54-fd331b4f602d service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:33.314468 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-6c989593-f923-4778-8db0-2b299af57396 req-38866961-bb73-423f-9f54-fd331b4f602d service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:33.328381 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-6c989593-f923-4778-8db0-2b299af57396 req-38866961-bb73-423f-9f54-fd331b4f602d service nova] Creating event network-changed:4d10eb36-dce1-4c00-9fa1-a89e70dddb17 for instance c8f2132c-4b9b-4c53-81c5-29e734143042 on hv-cinder-78102 Jul 13 02:27:33.336879 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-6c989593-f923-4778-8db0-2b299af57396 req-38866961-bb73-423f-9f54-fd331b4f602d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039026 Jul 13 02:27:33.338177 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 40/76] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:27:33 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:27:33.346247 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-9f292cf9-e545-4ec5-8e55-359e6150eb52 req-19c6fa9d-1b0c-4a20-bbea-52ded17c59dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdd6e2b3-3294-448d-b390-4340eb1cf4fe", "name": "network-vif-plugged", "status": "completed", "tag": "a8589fd5-f6a3-4169-9e78-c802007a1513"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:27:33.348460 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:27:33.348460 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:27:33.357011 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-9f292cf9-e545-4ec5-8e55-359e6150eb52 req-19c6fa9d-1b0c-4a20-bbea-52ded17c59dd service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:33.357540 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-9f292cf9-e545-4ec5-8e55-359e6150eb52 req-19c6fa9d-1b0c-4a20-bbea-52ded17c59dd service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:33.370077 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-9f292cf9-e545-4ec5-8e55-359e6150eb52 req-19c6fa9d-1b0c-4a20-bbea-52ded17c59dd service nova] Creating event network-vif-plugged:a8589fd5-f6a3-4169-9e78-c802007a1513 for instance cdd6e2b3-3294-448d-b390-4340eb1cf4fe on hv-cinder-78102 Jul 13 02:27:33.376322 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-9f292cf9-e545-4ec5-8e55-359e6150eb52 req-19c6fa9d-1b0c-4a20-bbea-52ded17c59dd service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036263 Jul 13 02:27:33.381289 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 41/77] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:27:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:27:33.396649 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-aeff7619-72ef-4fa9-8078-5f58b7a9df5f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:33.397570 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-aeff7619-72ef-4fa9-8078-5f58b7a9df5f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:33.406766 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-aeff7619-72ef-4fa9-8078-5f58b7a9df5f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:33.407459 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-aeff7619-72ef-4fa9-8078-5f58b7a9df5f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:33.409419 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-aeff7619-72ef-4fa9-8078-5f58b7a9df5f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:33.410466 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-aeff7619-72ef-4fa9-8078-5f58b7a9df5f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:33.419718 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:33.419718 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:34.122908 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-95de35b9-c354-4f51-bb5f-bdd3eb5d4e17 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd9c7709a68475abdb5aba9f475b865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b02533417754144803237804ba3c72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:34.126235 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:34.126235 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:34.140820 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-95de35b9-c354-4f51-bb5f-bdd3eb5d4e17 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] 10.222.0.32 "GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe" status: 200 len: 1315 microversion: 2.1 time: 0.892466 Jul 13 02:27:34.141714 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 37/78] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:33 2021] GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe => generated 1315 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:34.164974 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-cb42c3cb-dab3-4096-bf12-8967f2e6f00a tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:34.165828 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-cb42c3cb-dab3-4096-bf12-8967f2e6f00a tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d7423adc-bb73-46e2-8ddf-203316b7094a] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:34.175313 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-cb42c3cb-dab3-4096-bf12-8967f2e6f00a tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:34.176051 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-cb42c3cb-dab3-4096-bf12-8967f2e6f00a tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:34.177060 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-cb42c3cb-dab3-4096-bf12-8967f2e6f00a tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:34.177884 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-cb42c3cb-dab3-4096-bf12-8967f2e6f00a tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:34.182949 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:34.182949 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:34.642722 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-aeff7619-72ef-4fa9-8078-5f58b7a9df5f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:34.645271 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:34.645271 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:34.653109 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-aeff7619-72ef-4fa9-8078-5f58b7a9df5f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1321 microversion: 2.1 time: 1.260958 Jul 13 02:27:34.662659 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 42/79] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:33 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1321 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:27:34.668905 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-369bc7ad-74ca-4f49-a4ee-4ab71bceb2b2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:34.669881 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-369bc7ad-74ca-4f49-a4ee-4ab71bceb2b2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:34.676996 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-369bc7ad-74ca-4f49-a4ee-4ab71bceb2b2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:34.677782 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-369bc7ad-74ca-4f49-a4ee-4ab71bceb2b2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:34.678765 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-369bc7ad-74ca-4f49-a4ee-4ab71bceb2b2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:34.679607 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-369bc7ad-74ca-4f49-a4ee-4ab71bceb2b2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:34.684867 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:34.684867 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:34.995238 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-cb42c3cb-dab3-4096-bf12-8967f2e6f00a tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:34.998687 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:34.998687 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:35.022538 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-cb42c3cb-dab3-4096-bf12-8967f2e6f00a tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a" status: 200 len: 1508 microversion: 2.1 time: 0.868304 Jul 13 02:27:35.027286 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 38/80] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:34 2021] GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a => generated 1508 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:35.034516 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-c713618e-cbb7-43e2-af98-a1cff4725b2b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:35.035385 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-c713618e-cbb7-43e2-af98-a1cff4725b2b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:35.043187 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c713618e-cbb7-43e2-af98-a1cff4725b2b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:35.044949 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c713618e-cbb7-43e2-af98-a1cff4725b2b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:35.045993 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c713618e-cbb7-43e2-af98-a1cff4725b2b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:35.046611 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c713618e-cbb7-43e2-af98-a1cff4725b2b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:35.050565 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:35.050565 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:35.279078 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-369bc7ad-74ca-4f49-a4ee-4ab71bceb2b2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:35.282567 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:35.282567 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:35.298328 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-369bc7ad-74ca-4f49-a4ee-4ab71bceb2b2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1364 microversion: 2.1 time: 0.632270 Jul 13 02:27:35.300661 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 43/81] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:34 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1364 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:35.308191 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-4862447f-8e83-46d3-a7d7-855b0b387d16 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:35.309177 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-4862447f-8e83-46d3-a7d7-855b0b387d16 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] [instance: cdd6e2b3-3294-448d-b390-4340eb1cf4fe] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:35.316335 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-4862447f-8e83-46d3-a7d7-855b0b387d16 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:35.316999 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-4862447f-8e83-46d3-a7d7-855b0b387d16 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:35.318856 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-4862447f-8e83-46d3-a7d7-855b0b387d16 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:35.319481 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-4862447f-8e83-46d3-a7d7-855b0b387d16 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:35.325428 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:35.325428 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:35.542317 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-c713618e-cbb7-43e2-af98-a1cff4725b2b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:35.545292 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:35.545292 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:35.553794 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-c713618e-cbb7-43e2-af98-a1cff4725b2b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:35.562626 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-c713618e-cbb7-43e2-af98-a1cff4725b2b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:35.564009 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-c713618e-cbb7-43e2-af98-a1cff4725b2b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1408 microversion: 2.20 time: 0.534853 Jul 13 02:27:35.566801 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 39/82] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:27:35 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1408 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:27:35.670932 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-d5f88a5e-4a69-40d6-92f2-db203d469e3f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:35.671849 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-d5f88a5e-4a69-40d6-92f2-db203d469e3f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:35.681015 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d5f88a5e-4a69-40d6-92f2-db203d469e3f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:35.681695 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d5f88a5e-4a69-40d6-92f2-db203d469e3f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:35.682947 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d5f88a5e-4a69-40d6-92f2-db203d469e3f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:35.686773 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d5f88a5e-4a69-40d6-92f2-db203d469e3f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:35.693028 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:35.693028 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:36.280208 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-4862447f-8e83-46d3-a7d7-855b0b387d16 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd9c7709a68475abdb5aba9f475b865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b02533417754144803237804ba3c72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:36.283355 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:36.283355 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:36.295436 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-4862447f-8e83-46d3-a7d7-855b0b387d16 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] 10.222.0.32 "GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe" status: 200 len: 1315 microversion: 2.1 time: 0.993013 Jul 13 02:27:36.296301 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 44/83] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:35 2021] GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe => generated 1315 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:36.372604 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-d5f88a5e-4a69-40d6-92f2-db203d469e3f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:36.375440 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:36.375440 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:36.383568 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-d5f88a5e-4a69-40d6-92f2-db203d469e3f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1321 microversion: 2.1 time: 0.715928 Jul 13 02:27:36.393292 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 40/84] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:35 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1321 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:27:36.398294 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [req-1b4a67ed-e121-4864-959f-65ef07113f32 req-35e11f0d-7119-4c01-a6f8-c28a6541075b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "163ad440-5d5c-420d-ab44-52f27c5e22dc", "name": "network-vif-plugged", "status": "completed", "tag": "b303b0dd-0f82-4db9-98d2-7bd04096a59a"}]} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:27:36.400255 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:27:36.400255 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: warnings.warn(msg) Jul 13 02:27:36.407285 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-1b4a67ed-e121-4864-959f-65ef07113f32 req-35e11f0d-7119-4c01-a6f8-c28a6541075b service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:36.408034 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-1b4a67ed-e121-4864-959f-65ef07113f32 req-35e11f0d-7119-4c01-a6f8-c28a6541075b service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:36.428316 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.compute.server_external_events [req-1b4a67ed-e121-4864-959f-65ef07113f32 req-35e11f0d-7119-4c01-a6f8-c28a6541075b service nova] Creating event network-vif-plugged:b303b0dd-0f82-4db9-98d2-7bd04096a59a for instance 163ad440-5d5c-420d-ab44-52f27c5e22dc on hv-cinder-78102 Jul 13 02:27:36.434958 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [req-1b4a67ed-e121-4864-959f-65ef07113f32 req-35e11f0d-7119-4c01-a6f8-c28a6541075b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040299 Jul 13 02:27:36.436110 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 41/85] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:27:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:27:36.443891 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-8125c0af-5cc7-4a01-a2d1-0969d3a8caf2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:36.445162 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-8125c0af-5cc7-4a01-a2d1-0969d3a8caf2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:36.459415 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8125c0af-5cc7-4a01-a2d1-0969d3a8caf2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:36.459865 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8125c0af-5cc7-4a01-a2d1-0969d3a8caf2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:36.460886 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8125c0af-5cc7-4a01-a2d1-0969d3a8caf2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:36.461378 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8125c0af-5cc7-4a01-a2d1-0969d3a8caf2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:36.466195 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:36.466195 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:36.555340 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-fe2df788-7cdd-42fa-b55b-6082aff10051 req-f69a52cd-9f6c-493a-93e8-c4d40b7e3c41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc5604ab-b605-4558-93e4-81a91df55684", "tag": "60c4d5a2-781e-4a87-a16c-c361e468e5ad"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:27:36.557059 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:27:36.557059 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:27:36.566285 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-fe2df788-7cdd-42fa-b55b-6082aff10051 req-f69a52cd-9f6c-493a-93e8-c4d40b7e3c41 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:36.566948 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-fe2df788-7cdd-42fa-b55b-6082aff10051 req-f69a52cd-9f6c-493a-93e8-c4d40b7e3c41 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:36.589737 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-fe2df788-7cdd-42fa-b55b-6082aff10051 req-f69a52cd-9f6c-493a-93e8-c4d40b7e3c41 service nova] Creating event network-changed:60c4d5a2-781e-4a87-a16c-c361e468e5ad for instance fc5604ab-b605-4558-93e4-81a91df55684 on hv-cinder-78102 Jul 13 02:27:36.607598 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-fe2df788-7cdd-42fa-b55b-6082aff10051 req-f69a52cd-9f6c-493a-93e8-c4d40b7e3c41 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.307488 Jul 13 02:27:36.608545 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 45/86] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:27:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:27:36.614509 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-6e26b924-6e85-4ebd-be86-f946d4d4533f tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:36.617034 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-6e26b924-6e85-4ebd-be86-f946d4d4533f tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:36.630794 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-6e26b924-6e85-4ebd-be86-f946d4d4533f tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:36.631442 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-6e26b924-6e85-4ebd-be86-f946d4d4533f tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:36.632416 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-6e26b924-6e85-4ebd-be86-f946d4d4533f tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:36.633003 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-6e26b924-6e85-4ebd-be86-f946d4d4533f tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:36.636375 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:36.636375 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:36.703269 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-8125c0af-5cc7-4a01-a2d1-0969d3a8caf2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:36.705975 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:36.705975 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:36.721521 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-8125c0af-5cc7-4a01-a2d1-0969d3a8caf2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1364 microversion: 2.1 time: 0.283750 Jul 13 02:27:36.733578 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 42/87] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:36 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1364 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:36.856035 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-6e26b924-6e85-4ebd-be86-f946d4d4533f tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:36.859104 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:36.859104 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:36.871736 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-6e26b924-6e85-4ebd-be86-f946d4d4533f tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:36.873271 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-6e26b924-6e85-4ebd-be86-f946d4d4533f tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:36.874493 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-6e26b924-6e85-4ebd-be86-f946d4d4533f tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1408 microversion: 2.20 time: 0.264893 Jul 13 02:27:36.875048 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 46/88] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:27:36 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1408 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:27:36.881437 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-7afdbc15-00ac-46e2-b53b-cf936401f58b tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "534a15cb-a8d8-4336-bd42-50daaf280553"}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:27:36.882710 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-7afdbc15-00ac-46e2-b53b-cf936401f58b tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d7423adc-bb73-46e2-8ddf-203316b7094a] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:36.889627 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7afdbc15-00ac-46e2-b53b-cf936401f58b tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:36.890296 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7afdbc15-00ac-46e2-b53b-cf936401f58b tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:36.891197 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7afdbc15-00ac-46e2-b53b-cf936401f58b tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:36.891689 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7afdbc15-00ac-46e2-b53b-cf936401f58b tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:36.894593 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:36.894593 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:37.057541 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3019: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:37.057541 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context, Jul 13 02:27:37.312253 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-df305b26-e8a3-4058-b58f-7dfc00f5f606 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:37.312860 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-df305b26-e8a3-4058-b58f-7dfc00f5f606 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] [instance: cdd6e2b3-3294-448d-b390-4340eb1cf4fe] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:37.318648 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-df305b26-e8a3-4058-b58f-7dfc00f5f606 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:37.319091 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-df305b26-e8a3-4058-b58f-7dfc00f5f606 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:37.319883 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-df305b26-e8a3-4058-b58f-7dfc00f5f606 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:37.320344 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-df305b26-e8a3-4058-b58f-7dfc00f5f606 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:37.323164 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:37.323164 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:37.501137 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-df305b26-e8a3-4058-b58f-7dfc00f5f606 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd9c7709a68475abdb5aba9f475b865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b02533417754144803237804ba3c72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:37.503745 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:37.503745 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:37.510814 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-df305b26-e8a3-4058-b58f-7dfc00f5f606 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] 10.222.0.32 "GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe" status: 200 len: 1502 microversion: 2.1 time: 0.202294 Jul 13 02:27:37.511385 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 47/89] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:37 2021] GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe => generated 1502 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:27:37.515826 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-acfab411-a030-4875-a007-f5f69638f52a tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:37.516423 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-acfab411-a030-4875-a007-f5f69638f52a tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:37.522180 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-acfab411-a030-4875-a007-f5f69638f52a tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:37.523400 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-acfab411-a030-4875-a007-f5f69638f52a tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:37.524271 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-acfab411-a030-4875-a007-f5f69638f52a tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:37.524703 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-acfab411-a030-4875-a007-f5f69638f52a tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:37.527749 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:37.527749 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:37.703916 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-acfab411-a030-4875-a007-f5f69638f52a tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:37.706719 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:37.706719 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:37.714630 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-acfab411-a030-4875-a007-f5f69638f52a tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1321 microversion: 2.1 time: 0.202268 Jul 13 02:27:37.715283 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 48/90] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:37 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:37.740414 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-d3e484ab-71f4-4f92-a0b0-5ad40faa36c3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:37.741176 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-d3e484ab-71f4-4f92-a0b0-5ad40faa36c3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:37.747570 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d3e484ab-71f4-4f92-a0b0-5ad40faa36c3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:37.748251 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d3e484ab-71f4-4f92-a0b0-5ad40faa36c3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:37.749269 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d3e484ab-71f4-4f92-a0b0-5ad40faa36c3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:37.749916 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d3e484ab-71f4-4f92-a0b0-5ad40faa36c3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:37.753205 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:37.753205 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:37.948083 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-d3e484ab-71f4-4f92-a0b0-5ad40faa36c3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:37.955217 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:37.955217 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:37.959985 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-d3e484ab-71f4-4f92-a0b0-5ad40faa36c3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1364 microversion: 2.1 time: 0.223063 Jul 13 02:27:37.961070 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 49/91] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:37 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1364 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:37.971131 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-de676e6f-b007-4d6d-9293-3c786c4b75c8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:37.971866 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-de676e6f-b007-4d6d-9293-3c786c4b75c8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:37.977566 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-de676e6f-b007-4d6d-9293-3c786c4b75c8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:37.978004 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-de676e6f-b007-4d6d-9293-3c786c4b75c8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:37.978782 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-de676e6f-b007-4d6d-9293-3c786c4b75c8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:37.979204 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-de676e6f-b007-4d6d-9293-3c786c4b75c8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:37.981980 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:37.981980 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:38.179156 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-de676e6f-b007-4d6d-9293-3c786c4b75c8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:38.189549 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:38.189549 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:38.191638 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-de676e6f-b007-4d6d-9293-3c786c4b75c8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:38.193120 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-de676e6f-b007-4d6d-9293-3c786c4b75c8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:38.194303 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-de676e6f-b007-4d6d-9293-3c786c4b75c8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1408 microversion: 2.20 time: 0.227183 Jul 13 02:27:38.204450 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 50/92] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:27:37 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1408 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:27:38.622072 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-ca6b29d1-402b-42c0-82d7-558598bdf237 req-efff1a93-599a-40be-94cf-704a141708c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "872b8d83-fdcf-4888-b1d3-64f49541426d", "tag": "49588aa8-e16a-42d4-9d7e-8c1cf67a6211"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:27:38.623634 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:27:38.623634 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:27:38.630259 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-ca6b29d1-402b-42c0-82d7-558598bdf237 req-efff1a93-599a-40be-94cf-704a141708c4 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:38.630704 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-ca6b29d1-402b-42c0-82d7-558598bdf237 req-efff1a93-599a-40be-94cf-704a141708c4 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:38.641207 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-ca6b29d1-402b-42c0-82d7-558598bdf237 req-efff1a93-599a-40be-94cf-704a141708c4 service nova] Creating event network-changed:49588aa8-e16a-42d4-9d7e-8c1cf67a6211 for instance 872b8d83-fdcf-4888-b1d3-64f49541426d on hv-cinder-78102 Jul 13 02:27:38.645778 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-ca6b29d1-402b-42c0-82d7-558598bdf237 req-efff1a93-599a-40be-94cf-704a141708c4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027355 Jul 13 02:27:38.646373 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 51/93] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:27:38 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:27:38.732310 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-495ed9ea-5178-408a-a5a3-3fb94776a0b5 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:38.732992 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-495ed9ea-5178-408a-a5a3-3fb94776a0b5 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:38.738905 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-495ed9ea-5178-408a-a5a3-3fb94776a0b5 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:38.739346 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-495ed9ea-5178-408a-a5a3-3fb94776a0b5 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:38.740101 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-495ed9ea-5178-408a-a5a3-3fb94776a0b5 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:38.740533 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-495ed9ea-5178-408a-a5a3-3fb94776a0b5 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:38.744008 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:38.744008 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:38.918999 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-495ed9ea-5178-408a-a5a3-3fb94776a0b5 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:38.921525 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:38.921525 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:38.928174 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-495ed9ea-5178-408a-a5a3-3fb94776a0b5 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1321 microversion: 2.1 time: 0.199643 Jul 13 02:27:38.928723 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 52/94] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:38 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1321 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:27:38.976963 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-cdb6de11-9851-4f40-a9d8-0fb1ffc4dff1 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:38.977568 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-cdb6de11-9851-4f40-a9d8-0fb1ffc4dff1 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:38.983316 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-cdb6de11-9851-4f40-a9d8-0fb1ffc4dff1 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:38.983753 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-cdb6de11-9851-4f40-a9d8-0fb1ffc4dff1 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:38.984511 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-cdb6de11-9851-4f40-a9d8-0fb1ffc4dff1 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:38.984936 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-cdb6de11-9851-4f40-a9d8-0fb1ffc4dff1 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:38.987812 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:38.987812 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:39.140906 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2940: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:39.140906 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: query.update(values) Jul 13 02:27:39.143419 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2941: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:39.143419 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return query.first() Jul 13 02:27:39.314570 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2940: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:39.314570 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: query.update(values) Jul 13 02:27:39.317196 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2941: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:39.317196 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return query.first() Jul 13 02:27:39.333771 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-cdb6de11-9851-4f40-a9d8-0fb1ffc4dff1 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:39.336471 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:39.336471 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:39.343333 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-7afdbc15-00ac-46e2-b53b-cf936401f58b tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "POST /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.465584 Jul 13 02:27:39.343644 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-cdb6de11-9851-4f40-a9d8-0fb1ffc4dff1 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1364 microversion: 2.1 time: 0.370854 Jul 13 02:27:39.344223 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 53/95] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:38 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1364 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:27:39.344605 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 43/96] 10.222.0.32 () {60 vars in 1323 bytes} [Tue Jul 13 02:27:36 2021] POST /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a/os-volume_attachments => generated 194 bytes in 2468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 02:27:39.370137 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-14bc2dfc-50aa-4051-bb9e-612850e41a82 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:39.372007 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-14bc2dfc-50aa-4051-bb9e-612850e41a82 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:39.384237 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-14bc2dfc-50aa-4051-bb9e-612850e41a82 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:39.384920 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-14bc2dfc-50aa-4051-bb9e-612850e41a82 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:39.386400 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-14bc2dfc-50aa-4051-bb9e-612850e41a82 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:39.386983 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-14bc2dfc-50aa-4051-bb9e-612850e41a82 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:39.391061 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:39.391061 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:39.899806 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-14bc2dfc-50aa-4051-bb9e-612850e41a82 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:39.902564 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:39.902564 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:39.910110 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-14bc2dfc-50aa-4051-bb9e-612850e41a82 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:39.911683 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-14bc2dfc-50aa-4051-bb9e-612850e41a82 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:39.912739 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-14bc2dfc-50aa-4051-bb9e-612850e41a82 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1408 microversion: 2.20 time: 0.567244 Jul 13 02:27:39.913295 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 54/97] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:27:39 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1408 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:27:39.945728 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-7d509e4d-9adb-4f15-9809-f92cd0d62bb5 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:39.946716 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-7d509e4d-9adb-4f15-9809-f92cd0d62bb5 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:39.953783 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7d509e4d-9adb-4f15-9809-f92cd0d62bb5 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:39.954434 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7d509e4d-9adb-4f15-9809-f92cd0d62bb5 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:39.955554 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7d509e4d-9adb-4f15-9809-f92cd0d62bb5 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:39.956119 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7d509e4d-9adb-4f15-9809-f92cd0d62bb5 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:39.960122 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:39.960122 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:39.972793 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-db1bb28d-cb14-4384-b893-6558ee2362f6 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a25cbba9-73af-482c-be5a-78fc23293d98"}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:27:39.973981 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-db1bb28d-cb14-4384-b893-6558ee2362f6 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] [instance: cdd6e2b3-3294-448d-b390-4340eb1cf4fe] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:39.981017 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-db1bb28d-cb14-4384-b893-6558ee2362f6 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:39.981598 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-db1bb28d-cb14-4384-b893-6558ee2362f6 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:39.982468 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-db1bb28d-cb14-4384-b893-6558ee2362f6 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:39.982989 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-db1bb28d-cb14-4384-b893-6558ee2362f6 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:39.985763 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:39.985763 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:40.139997 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3019: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:40.139997 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context, Jul 13 02:27:40.149802 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-7d509e4d-9adb-4f15-9809-f92cd0d62bb5 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:40.152422 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:40.152422 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:40.159941 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-7d509e4d-9adb-4f15-9809-f92cd0d62bb5 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1321 microversion: 2.1 time: 0.218852 Jul 13 02:27:40.160506 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 44/98] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:39 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:40.364604 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2940: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:40.364604 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: query.update(values) Jul 13 02:27:40.368242 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2941: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:40.368242 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return query.first() Jul 13 02:27:40.371700 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-aa8f4de3-2446-48eb-b475-5cec56f21cb2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:40.372758 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-aa8f4de3-2446-48eb-b475-5cec56f21cb2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:40.384099 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-aa8f4de3-2446-48eb-b475-5cec56f21cb2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:40.384801 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-aa8f4de3-2446-48eb-b475-5cec56f21cb2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:40.386426 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-aa8f4de3-2446-48eb-b475-5cec56f21cb2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:40.387223 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-aa8f4de3-2446-48eb-b475-5cec56f21cb2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:40.392700 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:40.392700 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:40.645714 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2940: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:40.645714 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: query.update(values) Jul 13 02:27:40.649445 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2941: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:40.649445 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return query.first() Jul 13 02:27:40.663065 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-aa8f4de3-2446-48eb-b475-5cec56f21cb2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:40.667549 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:40.667549 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:40.683513 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-aa8f4de3-2446-48eb-b475-5cec56f21cb2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1364 microversion: 2.1 time: 0.322959 Jul 13 02:27:40.684310 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 45/99] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:40 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1364 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:40.691401 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-db1bb28d-cb14-4384-b893-6558ee2362f6 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] 10.222.0.32 "POST /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.721963 Jul 13 02:27:40.692424 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 55/100] 10.222.0.32 () {60 vars in 1323 bytes} [Tue Jul 13 02:27:39 2021] POST /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe/os-volume_attachments => generated 194 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 02:27:40.931371 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-8986c1ad-3255-4563-bbdf-9d4862a714bf tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:40.932093 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-8986c1ad-3255-4563-bbdf-9d4862a714bf tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:40.938759 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8986c1ad-3255-4563-bbdf-9d4862a714bf tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:40.939289 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8986c1ad-3255-4563-bbdf-9d4862a714bf tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:40.940256 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8986c1ad-3255-4563-bbdf-9d4862a714bf tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:40.940759 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8986c1ad-3255-4563-bbdf-9d4862a714bf tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:40.944232 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:40.944232 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:41.169482 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-8986c1ad-3255-4563-bbdf-9d4862a714bf tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:41.175108 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:41.175108 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:41.182988 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-a56f894f-b9f9-4c78-90fa-5e581b0aa3f7 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:41.184660 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-a56f894f-b9f9-4c78-90fa-5e581b0aa3f7 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:41.187435 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-8986c1ad-3255-4563-bbdf-9d4862a714bf tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:41.190464 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-8986c1ad-3255-4563-bbdf-9d4862a714bf tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:41.191767 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-8986c1ad-3255-4563-bbdf-9d4862a714bf tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1408 microversion: 2.20 time: 0.264811 Jul 13 02:27:41.194289 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a56f894f-b9f9-4c78-90fa-5e581b0aa3f7 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:41.194899 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a56f894f-b9f9-4c78-90fa-5e581b0aa3f7 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:41.195934 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a56f894f-b9f9-4c78-90fa-5e581b0aa3f7 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:41.196373 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a56f894f-b9f9-4c78-90fa-5e581b0aa3f7 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:41.200032 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:41.200032 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:41.202952 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 46/101] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:27:40 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1408 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:27:41.393773 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-a56f894f-b9f9-4c78-90fa-5e581b0aa3f7 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:41.396415 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:41.396415 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:41.404486 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-a56f894f-b9f9-4c78-90fa-5e581b0aa3f7 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1321 microversion: 2.1 time: 0.231267 Jul 13 02:27:41.405266 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 56/102] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:41 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1321 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:27:41.527369 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [req-8adea2a4-df74-4414-a63e-4b472a68148b req-2566b615-8513-4ee7-b115-5a6b7c637760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8f2132c-4b9b-4c53-81c5-29e734143042", "name": "network-vif-plugged", "status": "completed", "tag": "4d10eb36-dce1-4c00-9fa1-a89e70dddb17"}]} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:27:41.529193 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:27:41.529193 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: warnings.warn(msg) Jul 13 02:27:41.536256 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-8adea2a4-df74-4414-a63e-4b472a68148b req-2566b615-8513-4ee7-b115-5a6b7c637760 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:41.538675 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-8adea2a4-df74-4414-a63e-4b472a68148b req-2566b615-8513-4ee7-b115-5a6b7c637760 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:41.550454 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.compute.server_external_events [req-8adea2a4-df74-4414-a63e-4b472a68148b req-2566b615-8513-4ee7-b115-5a6b7c637760 service nova] Creating event network-vif-plugged:4d10eb36-dce1-4c00-9fa1-a89e70dddb17 for instance c8f2132c-4b9b-4c53-81c5-29e734143042 on hv-cinder-78102 Jul 13 02:27:41.558526 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [req-8adea2a4-df74-4414-a63e-4b472a68148b req-2566b615-8513-4ee7-b115-5a6b7c637760 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035966 Jul 13 02:27:41.560869 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 47/103] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:27:41 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:27:41.701088 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-46a5fa77-c9b7-4b8f-abbc-c216a8990b77 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:41.701918 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-46a5fa77-c9b7-4b8f-abbc-c216a8990b77 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:41.715954 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-46a5fa77-c9b7-4b8f-abbc-c216a8990b77 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:41.716437 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-46a5fa77-c9b7-4b8f-abbc-c216a8990b77 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:41.717264 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-46a5fa77-c9b7-4b8f-abbc-c216a8990b77 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:41.717693 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-46a5fa77-c9b7-4b8f-abbc-c216a8990b77 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:41.721209 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:41.721209 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:41.949506 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-46a5fa77-c9b7-4b8f-abbc-c216a8990b77 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:41.952161 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:41.952161 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:41.959542 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-46a5fa77-c9b7-4b8f-abbc-c216a8990b77 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1364 microversion: 2.1 time: 0.262060 Jul 13 02:27:41.960665 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 57/104] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:41 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1364 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:42.210986 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-8da635d6-577a-42b2-a75b-0aa2c95b189e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:42.211686 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-8da635d6-577a-42b2-a75b-0aa2c95b189e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:42.219361 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8da635d6-577a-42b2-a75b-0aa2c95b189e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:42.219361 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8da635d6-577a-42b2-a75b-0aa2c95b189e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:42.219361 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8da635d6-577a-42b2-a75b-0aa2c95b189e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:42.219361 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8da635d6-577a-42b2-a75b-0aa2c95b189e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:42.222007 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:42.222007 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:42.405399 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-8da635d6-577a-42b2-a75b-0aa2c95b189e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:42.408204 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:42.408204 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:42.416223 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-8da635d6-577a-42b2-a75b-0aa2c95b189e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:42.417769 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-8da635d6-577a-42b2-a75b-0aa2c95b189e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:42.418882 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-8da635d6-577a-42b2-a75b-0aa2c95b189e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1408 microversion: 2.20 time: 0.212881 Jul 13 02:27:42.419607 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 48/105] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:27:42 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1408 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:27:42.421369 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-6ba03620-763f-42d6-9f60-2e99d2309f39 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:42.421972 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-6ba03620-763f-42d6-9f60-2e99d2309f39 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:42.427773 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-6ba03620-763f-42d6-9f60-2e99d2309f39 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:42.428217 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-6ba03620-763f-42d6-9f60-2e99d2309f39 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:42.429591 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-6ba03620-763f-42d6-9f60-2e99d2309f39 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:42.432528 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-6ba03620-763f-42d6-9f60-2e99d2309f39 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:42.434040 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:42.434040 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:42.617434 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-6ba03620-763f-42d6-9f60-2e99d2309f39 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:42.620276 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:42.620276 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:42.627552 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-6ba03620-763f-42d6-9f60-2e99d2309f39 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1321 microversion: 2.1 time: 0.209593 Jul 13 02:27:42.628165 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 58/106] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:42 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:27:42.977465 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-33764499-03f4-45bf-944c-768b54e910d8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:42.978211 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-33764499-03f4-45bf-944c-768b54e910d8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:42.984113 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-33764499-03f4-45bf-944c-768b54e910d8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:42.984570 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-33764499-03f4-45bf-944c-768b54e910d8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:42.985350 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-33764499-03f4-45bf-944c-768b54e910d8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:42.985789 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-33764499-03f4-45bf-944c-768b54e910d8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:42.988730 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:42.988730 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:43.205641 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-33764499-03f4-45bf-944c-768b54e910d8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:43.208229 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:43.208229 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:43.220910 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-33764499-03f4-45bf-944c-768b54e910d8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1364 microversion: 2.1 time: 0.245615 Jul 13 02:27:43.222091 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 49/107] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:42 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1364 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:43.440670 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-b0643d8f-1a26-4df6-a47d-9d665eda63ed tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:43.441905 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-b0643d8f-1a26-4df6-a47d-9d665eda63ed tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:43.457935 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b0643d8f-1a26-4df6-a47d-9d665eda63ed tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:43.461217 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b0643d8f-1a26-4df6-a47d-9d665eda63ed tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:43.462135 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b0643d8f-1a26-4df6-a47d-9d665eda63ed tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:43.463672 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b0643d8f-1a26-4df6-a47d-9d665eda63ed tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:43.473353 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:43.473353 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:43.629652 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [req-419bbae3-92c3-47c5-bd46-3a103009a7ad req-c65225e2-1d18-4975-bcf2-1280db08ee63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc5604ab-b605-4558-93e4-81a91df55684", "name": "network-vif-plugged", "status": "completed", "tag": "60c4d5a2-781e-4a87-a16c-c361e468e5ad"}]} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:27:43.631459 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:27:43.631459 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: warnings.warn(msg) Jul 13 02:27:43.645423 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-419bbae3-92c3-47c5-bd46-3a103009a7ad req-c65225e2-1d18-4975-bcf2-1280db08ee63 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:43.647268 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-419bbae3-92c3-47c5-bd46-3a103009a7ad req-c65225e2-1d18-4975-bcf2-1280db08ee63 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:43.659884 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.compute.server_external_events [req-419bbae3-92c3-47c5-bd46-3a103009a7ad req-c65225e2-1d18-4975-bcf2-1280db08ee63 service nova] Creating event network-vif-plugged:60c4d5a2-781e-4a87-a16c-c361e468e5ad for instance fc5604ab-b605-4558-93e4-81a91df55684 on hv-cinder-78102 Jul 13 02:27:43.671541 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [req-419bbae3-92c3-47c5-bd46-3a103009a7ad req-c65225e2-1d18-4975-bcf2-1280db08ee63 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045641 Jul 13 02:27:43.672405 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 50/108] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:27:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 02:27:43.681872 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-d59b6fa2-a202-4604-8b1f-345fd45121b4 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:43.686991 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-d59b6fa2-a202-4604-8b1f-345fd45121b4 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:43.694006 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d59b6fa2-a202-4604-8b1f-345fd45121b4 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:43.694819 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d59b6fa2-a202-4604-8b1f-345fd45121b4 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:43.695808 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d59b6fa2-a202-4604-8b1f-345fd45121b4 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:43.696428 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d59b6fa2-a202-4604-8b1f-345fd45121b4 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:43.699927 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:43.699927 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:43.937290 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-b0643d8f-1a26-4df6-a47d-9d665eda63ed tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:43.940156 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:43.940156 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:43.955325 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-b0643d8f-1a26-4df6-a47d-9d665eda63ed tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:43.956813 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-b0643d8f-1a26-4df6-a47d-9d665eda63ed tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:43.957959 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-b0643d8f-1a26-4df6-a47d-9d665eda63ed tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1408 microversion: 2.20 time: 0.522806 Jul 13 02:27:43.966764 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 59/109] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:27:43 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1408 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:27:44.065641 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-d59b6fa2-a202-4604-8b1f-345fd45121b4 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:44.068796 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:44.068796 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:44.080834 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-d59b6fa2-a202-4604-8b1f-345fd45121b4 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1321 microversion: 2.1 time: 0.403582 Jul 13 02:27:44.082791 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 51/110] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:43 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1321 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:44.239369 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-715ce42d-3b1b-48f7-91bb-1966b216ee73 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:44.240182 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-715ce42d-3b1b-48f7-91bb-1966b216ee73 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:44.249396 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-715ce42d-3b1b-48f7-91bb-1966b216ee73 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:44.250113 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-715ce42d-3b1b-48f7-91bb-1966b216ee73 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:44.251106 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-715ce42d-3b1b-48f7-91bb-1966b216ee73 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:44.251759 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-715ce42d-3b1b-48f7-91bb-1966b216ee73 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:44.255766 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:44.255766 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:44.481845 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-715ce42d-3b1b-48f7-91bb-1966b216ee73 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:44.484498 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:44.484498 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:44.491950 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-715ce42d-3b1b-48f7-91bb-1966b216ee73 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1550 microversion: 2.1 time: 0.256418 Jul 13 02:27:44.492663 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 60/111] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:44 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1550 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:27:44.511879 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-882a96be-0cb4-4a46-b07e-1151e250f2dd tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:44.512403 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-882a96be-0cb4-4a46-b07e-1151e250f2dd tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:44.519194 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-882a96be-0cb4-4a46-b07e-1151e250f2dd tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:44.519734 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-882a96be-0cb4-4a46-b07e-1151e250f2dd tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:44.520726 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-882a96be-0cb4-4a46-b07e-1151e250f2dd tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:44.521230 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-882a96be-0cb4-4a46-b07e-1151e250f2dd tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:44.526290 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:44.526290 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:44.760793 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-882a96be-0cb4-4a46-b07e-1151e250f2dd tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.254573 Jul 13 02:27:44.761667 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 52/112] 10.222.0.32 () {58 vars in 1275 bytes} [Tue Jul 13 02:27:44 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/os-interface => generated 284 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:27:44.986250 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-4173e071-9875-4886-8af1-43417e518e01 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:44.986884 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-4173e071-9875-4886-8af1-43417e518e01 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:44.999849 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-4173e071-9875-4886-8af1-43417e518e01 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:45.000304 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-4173e071-9875-4886-8af1-43417e518e01 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:45.001276 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-4173e071-9875-4886-8af1-43417e518e01 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:45.001721 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-4173e071-9875-4886-8af1-43417e518e01 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:45.004917 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:45.004917 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:45.100350 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-c172773b-8313-4baa-8257-c2dfb8317c35 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:45.101281 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-c172773b-8313-4baa-8257-c2dfb8317c35 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:45.111399 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c172773b-8313-4baa-8257-c2dfb8317c35 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:45.112076 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c172773b-8313-4baa-8257-c2dfb8317c35 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:45.113053 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c172773b-8313-4baa-8257-c2dfb8317c35 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:45.113646 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c172773b-8313-4baa-8257-c2dfb8317c35 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:45.129515 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:45.129515 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:45.354478 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-4173e071-9875-4886-8af1-43417e518e01 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:45.358713 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:45.358713 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:45.367602 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-4173e071-9875-4886-8af1-43417e518e01 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:45.369873 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-4173e071-9875-4886-8af1-43417e518e01 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:45.371305 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-4173e071-9875-4886-8af1-43417e518e01 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1408 microversion: 2.20 time: 0.389697 Jul 13 02:27:45.387000 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 61/113] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:27:44 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1408 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:27:45.510501 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-c172773b-8313-4baa-8257-c2dfb8317c35 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:45.516698 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:45.516698 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:45.534975 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-c172773b-8313-4baa-8257-c2dfb8317c35 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1321 microversion: 2.1 time: 0.437901 Jul 13 02:27:45.546316 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 53/114] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:45 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1321 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:46.395748 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-06b892f1-fca6-41e4-915f-b4b7c7870d7b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:46.400150 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-06b892f1-fca6-41e4-915f-b4b7c7870d7b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:46.407749 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-06b892f1-fca6-41e4-915f-b4b7c7870d7b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:46.408355 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-06b892f1-fca6-41e4-915f-b4b7c7870d7b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:46.409236 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-06b892f1-fca6-41e4-915f-b4b7c7870d7b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:46.409893 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-06b892f1-fca6-41e4-915f-b4b7c7870d7b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:46.413345 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:46.413345 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:46.553383 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-d182926c-5c03-45a5-a411-81b81f6b77d3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:46.554223 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-d182926c-5c03-45a5-a411-81b81f6b77d3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:46.564214 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d182926c-5c03-45a5-a411-81b81f6b77d3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:46.566339 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d182926c-5c03-45a5-a411-81b81f6b77d3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:46.567221 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d182926c-5c03-45a5-a411-81b81f6b77d3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:46.567823 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d182926c-5c03-45a5-a411-81b81f6b77d3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:46.572329 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:46.572329 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:46.668367 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-06b892f1-fca6-41e4-915f-b4b7c7870d7b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:46.670964 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:46.670964 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:46.679315 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-06b892f1-fca6-41e4-915f-b4b7c7870d7b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:46.680968 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-06b892f1-fca6-41e4-915f-b4b7c7870d7b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:46.682719 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-06b892f1-fca6-41e4-915f-b4b7c7870d7b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1408 microversion: 2.20 time: 0.297267 Jul 13 02:27:46.696912 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 62/115] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:27:46 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1408 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:27:46.702836 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-9aed37d0-22ac-42c9-9b58-f84253f17730 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:27:46.703849 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-9aed37d0-22ac-42c9-9b58-f84253f17730 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:46.718699 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9aed37d0-22ac-42c9-9b58-f84253f17730 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:46.719147 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9aed37d0-22ac-42c9-9b58-f84253f17730 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:46.719937 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9aed37d0-22ac-42c9-9b58-f84253f17730 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:46.720370 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9aed37d0-22ac-42c9-9b58-f84253f17730 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:46.723392 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:46.723392 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:46.831505 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-d182926c-5c03-45a5-a411-81b81f6b77d3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:46.834612 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:46.834612 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:46.842201 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-d182926c-5c03-45a5-a411-81b81f6b77d3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1515 microversion: 2.1 time: 0.292322 Jul 13 02:27:46.843350 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 54/116] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:46 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1515 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:46.848386 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [req-d062d86e-7434-46f2-9ab5-8414b4e8f7b5 req-094bad95-4b27-46db-b6e0-5d69b3c28068 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8f2132c-4b9b-4c53-81c5-29e734143042", "tag": "4d10eb36-dce1-4c00-9fa1-a89e70dddb17"}]} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:27:46.850195 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:27:46.850195 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: warnings.warn(msg) Jul 13 02:27:46.859564 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-d062d86e-7434-46f2-9ab5-8414b4e8f7b5 req-094bad95-4b27-46db-b6e0-5d69b3c28068 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:46.860258 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-d062d86e-7434-46f2-9ab5-8414b4e8f7b5 req-094bad95-4b27-46db-b6e0-5d69b3c28068 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:46.873236 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.compute.server_external_events [req-d062d86e-7434-46f2-9ab5-8414b4e8f7b5 req-094bad95-4b27-46db-b6e0-5d69b3c28068 service nova] Creating event network-changed:4d10eb36-dce1-4c00-9fa1-a89e70dddb17 for instance c8f2132c-4b9b-4c53-81c5-29e734143042 on hv-cinder-78102 Jul 13 02:27:46.878474 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [req-d062d86e-7434-46f2-9ab5-8414b4e8f7b5 req-094bad95-4b27-46db-b6e0-5d69b3c28068 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033531 Jul 13 02:27:46.879335 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 55/117] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:27:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:27:46.886063 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-49714482-fa56-4953-a141-287dabd8f0f9 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:27:46.887473 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-49714482-fa56-4953-a141-287dabd8f0f9 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:46.895438 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-49714482-fa56-4953-a141-287dabd8f0f9 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:46.896140 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-49714482-fa56-4953-a141-287dabd8f0f9 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:46.897105 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-49714482-fa56-4953-a141-287dabd8f0f9 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:46.898181 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-49714482-fa56-4953-a141-287dabd8f0f9 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:46.902298 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:46.902298 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:46.903992 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-9aed37d0-22ac-42c9-9b58-f84253f17730 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 200 len: 14 microversion: 2.1 time: 0.205541 Jul 13 02:27:46.905164 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 63/118] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:27:46 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 14 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 13 02:27:46.973707 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.objects.instance [None req-49714482-fa56-4953-a141-287dabd8f0f9 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lazy-loading 'flavor' on Instance uuid fc5604ab-b605-4558-93e4-81a91df55684 {{(pid=107263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 13 02:27:47.034317 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3008: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:47.034317 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).\ Jul 13 02:27:47.049954 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2557: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:47.049954 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: rows_updated = model_query(context, models.InstanceExtra).\ Jul 13 02:27:47.065957 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:47.065957 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:47.198078 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/update_match.py:472: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:47.198078 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = query.session.execute(update_stmt) Jul 13 02:27:47.250935 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-49714482-fa56-4953-a141-287dabd8f0f9 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "POST /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684/action" status: 200 len: 32 microversion: 2.1 time: 0.369155 Jul 13 02:27:47.252798 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 56/119] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:27:46 2021] POST /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684/action => generated 32 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 13 02:27:47.270666 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-672711d6-e95e-47a8-ab69-7c718833c7bc tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:47.271654 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-672711d6-e95e-47a8-ab69-7c718833c7bc tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:47.302046 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-672711d6-e95e-47a8-ab69-7c718833c7bc tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:47.307278 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-672711d6-e95e-47a8-ab69-7c718833c7bc tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:47.309335 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-672711d6-e95e-47a8-ab69-7c718833c7bc tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:47.312284 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-672711d6-e95e-47a8-ab69-7c718833c7bc tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:47.326564 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:47.326564 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:47.415887 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [req-840fd201-dd18-42f9-870b-24ac4e2ee0bf req-79b70b42-8b0a-4ecc-b5eb-146cfba5d341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "872b8d83-fdcf-4888-b1d3-64f49541426d", "name": "network-vif-plugged", "status": "completed", "tag": "49588aa8-e16a-42d4-9d7e-8c1cf67a6211"}]} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:27:47.417548 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:27:47.417548 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: warnings.warn(msg) Jul 13 02:27:47.443903 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-840fd201-dd18-42f9-870b-24ac4e2ee0bf req-79b70b42-8b0a-4ecc-b5eb-146cfba5d341 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:47.446509 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-840fd201-dd18-42f9-870b-24ac4e2ee0bf req-79b70b42-8b0a-4ecc-b5eb-146cfba5d341 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:47.497327 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.compute.server_external_events [req-840fd201-dd18-42f9-870b-24ac4e2ee0bf req-79b70b42-8b0a-4ecc-b5eb-146cfba5d341 service nova] Creating event network-vif-plugged:49588aa8-e16a-42d4-9d7e-8c1cf67a6211 for instance 872b8d83-fdcf-4888-b1d3-64f49541426d on hv-cinder-78102 Jul 13 02:27:47.513076 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [req-840fd201-dd18-42f9-870b-24ac4e2ee0bf req-79b70b42-8b0a-4ecc-b5eb-146cfba5d341 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102417 Jul 13 02:27:47.515366 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 57/120] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:27:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:27:47.706907 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-625321a7-16d2-4b15-8b0a-546af165b15e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:47.707737 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-625321a7-16d2-4b15-8b0a-546af165b15e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:47.727181 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-625321a7-16d2-4b15-8b0a-546af165b15e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:47.730459 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-625321a7-16d2-4b15-8b0a-546af165b15e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:47.735791 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-625321a7-16d2-4b15-8b0a-546af165b15e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:47.736917 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-625321a7-16d2-4b15-8b0a-546af165b15e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:47.750850 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:47.750850 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:48.262284 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-672711d6-e95e-47a8-ab69-7c718833c7bc tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:48.266743 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:48.266743 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:48.276170 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-672711d6-e95e-47a8-ab69-7c718833c7bc tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1521 microversion: 2.1 time: 1.017402 Jul 13 02:27:48.285857 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 64/121] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:47 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1521 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:48.300442 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-a532e2f9-8338-49ce-8c56-d1734cac7383 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:27:48.301598 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-a532e2f9-8338-49ce-8c56-d1734cac7383 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:48.315448 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a532e2f9-8338-49ce-8c56-d1734cac7383 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:48.316700 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a532e2f9-8338-49ce-8c56-d1734cac7383 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:48.318010 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a532e2f9-8338-49ce-8c56-d1734cac7383 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:48.319840 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a532e2f9-8338-49ce-8c56-d1734cac7383 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:48.330874 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:48.330874 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:48.514130 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-a532e2f9-8338-49ce-8c56-d1734cac7383 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 200 len: 14 microversion: 2.1 time: 0.226695 Jul 13 02:27:48.515000 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 65/122] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:27:48 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 14 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 13 02:27:48.552441 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-625321a7-16d2-4b15-8b0a-546af165b15e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:48.555726 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:48.555726 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:48.565881 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-625321a7-16d2-4b15-8b0a-546af165b15e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:48.567788 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-625321a7-16d2-4b15-8b0a-546af165b15e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:48.570940 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-625321a7-16d2-4b15-8b0a-546af165b15e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1408 microversion: 2.20 time: 0.868727 Jul 13 02:27:48.581671 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 58/123] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:27:47 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1408 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:27:49.304982 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-f1f54010-51bd-46ea-b70b-6c53567ac384 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:49.304982 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-f1f54010-51bd-46ea-b70b-6c53567ac384 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:49.311550 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f1f54010-51bd-46ea-b70b-6c53567ac384 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:49.312290 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f1f54010-51bd-46ea-b70b-6c53567ac384 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:49.313706 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f1f54010-51bd-46ea-b70b-6c53567ac384 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:49.314456 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f1f54010-51bd-46ea-b70b-6c53567ac384 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:49.319942 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:49.319942 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:49.530868 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-5ef8f343-e6cf-4aa6-8bf5-ab51d411d902 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:27:49.531775 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-5ef8f343-e6cf-4aa6-8bf5-ab51d411d902 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:49.544169 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5ef8f343-e6cf-4aa6-8bf5-ab51d411d902 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:49.544611 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5ef8f343-e6cf-4aa6-8bf5-ab51d411d902 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:49.545381 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5ef8f343-e6cf-4aa6-8bf5-ab51d411d902 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:49.545806 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5ef8f343-e6cf-4aa6-8bf5-ab51d411d902 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:49.548647 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:49.548647 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:49.708166 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-f1f54010-51bd-46ea-b70b-6c53567ac384 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:49.711559 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:49.711559 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:49.718679 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-f1f54010-51bd-46ea-b70b-6c53567ac384 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1521 microversion: 2.1 time: 0.427381 Jul 13 02:27:49.728612 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 66/124] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:49 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1521 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:49.733789 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-3b865c3f-fd5e-4e99-acda-ec65c9e056dd tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:49.734411 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-3b865c3f-fd5e-4e99-acda-ec65c9e056dd tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:49.742211 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3b865c3f-fd5e-4e99-acda-ec65c9e056dd tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:49.742211 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3b865c3f-fd5e-4e99-acda-ec65c9e056dd tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:49.742211 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3b865c3f-fd5e-4e99-acda-ec65c9e056dd tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:49.742211 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3b865c3f-fd5e-4e99-acda-ec65c9e056dd tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:49.744725 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:49.744725 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:49.877095 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-5ef8f343-e6cf-4aa6-8bf5-ab51d411d902 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 200 len: 14 microversion: 2.1 time: 0.349238 Jul 13 02:27:49.878517 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 59/125] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:27:49 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 14 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 13 02:27:49.884973 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-2e6ef001-6d18-4c7c-9e6f-f9deda504820 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1706302343", "imageRef": "1a3efd47-3618-4abd-b00b-a9fa9b90b4d4", "flavorRef": "452", "networks": [{"uuid": "bbf39b0f-a6a8-4156-9bab-028e4f2bf745"}]}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:27:49.945145 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-3b865c3f-fd5e-4e99-acda-ec65c9e056dd tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:49.948358 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:49.948358 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:49.949351 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.network.neutron [None req-2e6ef001-6d18-4c7c-9e6f-f9deda504820 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] validate_networks() for [('bbf39b0f-a6a8-4156-9bab-028e4f2bf745', None, None, None)] {{(pid=107263) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Jul 13 02:27:49.958657 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-3b865c3f-fd5e-4e99-acda-ec65c9e056dd tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:49.960802 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-3b865c3f-fd5e-4e99-acda-ec65c9e056dd tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:49.962833 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-3b865c3f-fd5e-4e99-acda-ec65c9e056dd tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1408 microversion: 2.20 time: 0.232667 Jul 13 02:27:49.963929 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 67/126] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:27:49 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1408 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:27:50.435502 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-2e6ef001-6d18-4c7c-9e6f-f9deda504820 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Flavor limits 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 02:27:50.435931 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-2e6ef001-6d18-4c7c-9e6f-f9deda504820 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Image limits 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 02:27:50.436405 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-2e6ef001-6d18-4c7c-9e6f-f9deda504820 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Flavor pref 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 02:27:50.436813 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-2e6ef001-6d18-4c7c-9e6f-f9deda504820 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Image pref 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 02:27:50.437221 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-2e6ef001-6d18-4c7c-9e6f-f9deda504820 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 02:27:50.443655 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2690: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:50.443655 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: user_quotas = model_query(context, models.ProjectUserQuota, Jul 13 02:27:50.447859 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2e6ef001-6d18-4c7c-9e6f-f9deda504820 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:50.448344 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2e6ef001-6d18-4c7c-9e6f-f9deda504820 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:50.449292 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2e6ef001-6d18-4c7c-9e6f-f9deda504820 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:50.449977 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2e6ef001-6d18-4c7c-9e6f-f9deda504820 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:50.453195 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/objects/instance.py:1537: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:50.453195 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: project_result = project_query.first() Jul 13 02:27:50.471085 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2708: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:50.471085 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: rows = model_query(context, models.Quota, read_deleted="no").\ Jul 13 02:27:50.474833 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.quota [None req-2e6ef001-6d18-4c7c-9e6f-f9deda504820 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Getting quotas for project 6b3bcc4decdb4d42a7f3efd99887e102. Resources: {'ram', 'cores', 'instances'} {{(pid=107263) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 13 02:27:50.479549 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.quota [None req-2e6ef001-6d18-4c7c-9e6f-f9deda504820 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Getting quotas for user f236dcca98c04f60aa827231eede0815 and project 6b3bcc4decdb4d42a7f3efd99887e102. Resources: {'ram', 'cores', 'instances'} {{(pid=107263) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 13 02:27:50.493235 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-2e6ef001-6d18-4c7c-9e6f-f9deda504820 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Going to run 1 instances... {{(pid=107263) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 13 02:27:50.506008 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-2e6ef001-6d18-4c7c-9e6f-f9deda504820 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d5e93419-e7dd-4cb3-9370-d46ec80bac7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a3efd47-3618-4abd-b00b-a9fa9b90b4d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 13 02:27:50.548618 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-2e6ef001-6d18-4c7c-9e6f-f9deda504820 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.668245 Jul 13 02:27:50.549978 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 60/127] 10.222.0.32 () {60 vars in 1147 bytes} [Tue Jul 13 02:27:49 2021] POST /compute/v2.1/servers => generated 380 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 02:27:50.559969 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-dbfb47f5-941b-48bf-aa58-16ee7ab6cd87 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:50.561768 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-dbfb47f5-941b-48bf-aa58-16ee7ab6cd87 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d5e93419-e7dd-4cb3-9370-d46ec80bac7c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:50.636423 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-dbfb47f5-941b-48bf-aa58-16ee7ab6cd87 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:50.639790 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:50.639790 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:50.651096 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-dbfb47f5-941b-48bf-aa58-16ee7ab6cd87 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/d5e93419-e7dd-4cb3-9370-d46ec80bac7c" status: 200 len: 1218 microversion: 2.1 time: 0.094897 Jul 13 02:27:50.653025 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 68/128] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:50 2021] GET /compute/v2.1/servers/d5e93419-e7dd-4cb3-9370-d46ec80bac7c => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:50.737404 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-0c234dae-bebc-46f6-93d6-c1ff600267b9 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:50.738277 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-0c234dae-bebc-46f6-93d6-c1ff600267b9 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:50.747147 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0c234dae-bebc-46f6-93d6-c1ff600267b9 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:50.747566 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0c234dae-bebc-46f6-93d6-c1ff600267b9 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:50.748825 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0c234dae-bebc-46f6-93d6-c1ff600267b9 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:50.749259 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0c234dae-bebc-46f6-93d6-c1ff600267b9 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:50.753573 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:50.753573 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:50.890525 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-bea2fb01-8075-4e0d-8832-ba7f64b6b213 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:27:50.891718 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-bea2fb01-8075-4e0d-8832-ba7f64b6b213 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:50.899285 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-bea2fb01-8075-4e0d-8832-ba7f64b6b213 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:50.900080 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-bea2fb01-8075-4e0d-8832-ba7f64b6b213 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:50.900874 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-bea2fb01-8075-4e0d-8832-ba7f64b6b213 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:50.901500 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-bea2fb01-8075-4e0d-8832-ba7f64b6b213 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:50.905466 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:50.905466 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:50.986083 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-0c234dae-bebc-46f6-93d6-c1ff600267b9 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:50.989682 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:50.989682 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:50.999750 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-0c234dae-bebc-46f6-93d6-c1ff600267b9 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1521 microversion: 2.1 time: 0.267042 Jul 13 02:27:51.000508 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 61/129] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:50 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:51.005018 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-484f88d1-6b27-42e2-b448-9db3137ff643 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:51.005612 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-484f88d1-6b27-42e2-b448-9db3137ff643 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:51.018591 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-484f88d1-6b27-42e2-b448-9db3137ff643 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:51.019244 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-484f88d1-6b27-42e2-b448-9db3137ff643 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:51.020258 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-484f88d1-6b27-42e2-b448-9db3137ff643 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:51.020849 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-484f88d1-6b27-42e2-b448-9db3137ff643 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:51.025757 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:51.025757 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:51.105310 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-bea2fb01-8075-4e0d-8832-ba7f64b6b213 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 200 len: 14 microversion: 2.1 time: 0.219820 Jul 13 02:27:51.105968 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 69/130] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:27:50 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 14 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 13 02:27:51.305859 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-484f88d1-6b27-42e2-b448-9db3137ff643 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:51.313143 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:51.313143 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:51.329685 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-484f88d1-6b27-42e2-b448-9db3137ff643 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:51.331285 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-484f88d1-6b27-42e2-b448-9db3137ff643 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:51.332468 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-484f88d1-6b27-42e2-b448-9db3137ff643 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1600 microversion: 2.20 time: 0.330787 Jul 13 02:27:51.333151 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 62/131] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:27:51 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1600 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:27:51.358741 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-36b49587-cdef-42e8-97b3-4162de6b46c2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:51.359645 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-36b49587-cdef-42e8-97b3-4162de6b46c2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:51.369380 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-36b49587-cdef-42e8-97b3-4162de6b46c2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:51.370164 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-36b49587-cdef-42e8-97b3-4162de6b46c2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:51.371386 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-36b49587-cdef-42e8-97b3-4162de6b46c2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:51.372094 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-36b49587-cdef-42e8-97b3-4162de6b46c2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:51.375483 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:51.375483 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:51.561769 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-36b49587-cdef-42e8-97b3-4162de6b46c2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.208159 Jul 13 02:27:51.567962 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 70/132] 10.222.0.32 () {60 vars in 1316 bytes} [Tue Jul 13 02:27:51 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/os-interface => generated 285 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:27:51.668625 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-e9619395-f803-4580-a6f6-22aeca0ab18c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:51.669243 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-e9619395-f803-4580-a6f6-22aeca0ab18c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d5e93419-e7dd-4cb3-9370-d46ec80bac7c] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:51.674974 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e9619395-f803-4580-a6f6-22aeca0ab18c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:51.675418 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e9619395-f803-4580-a6f6-22aeca0ab18c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:51.676354 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e9619395-f803-4580-a6f6-22aeca0ab18c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:51.676782 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e9619395-f803-4580-a6f6-22aeca0ab18c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:51.680639 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:51.680639 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:51.800364 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-e9619395-f803-4580-a6f6-22aeca0ab18c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:51.803032 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:51.803032 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:51.815271 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-e9619395-f803-4580-a6f6-22aeca0ab18c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/d5e93419-e7dd-4cb3-9370-d46ec80bac7c" status: 200 len: 1270 microversion: 2.1 time: 0.150304 Jul 13 02:27:51.816004 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 63/133] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:51 2021] GET /compute/v2.1/servers/d5e93419-e7dd-4cb3-9370-d46ec80bac7c => generated 1270 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:27:52.020486 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-24265d99-da54-44f1-9b5e-cb3b9006f80b tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:52.021381 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-24265d99-da54-44f1-9b5e-cb3b9006f80b tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:52.028949 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-24265d99-da54-44f1-9b5e-cb3b9006f80b tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:52.029764 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-24265d99-da54-44f1-9b5e-cb3b9006f80b tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:52.030944 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-24265d99-da54-44f1-9b5e-cb3b9006f80b tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:52.031722 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-24265d99-da54-44f1-9b5e-cb3b9006f80b tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:52.036415 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:52.036415 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:52.117670 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-8f626275-ad17-4047-aa43-7d7495439749 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:27:52.118732 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-8f626275-ad17-4047-aa43-7d7495439749 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:52.129696 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8f626275-ad17-4047-aa43-7d7495439749 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:52.130349 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8f626275-ad17-4047-aa43-7d7495439749 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:52.135389 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8f626275-ad17-4047-aa43-7d7495439749 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:52.135862 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8f626275-ad17-4047-aa43-7d7495439749 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:52.139217 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:52.139217 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:52.242573 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-24265d99-da54-44f1-9b5e-cb3b9006f80b tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:52.245033 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:52.245033 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:52.252755 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-24265d99-da54-44f1-9b5e-cb3b9006f80b tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1521 microversion: 2.1 time: 0.237683 Jul 13 02:27:52.253329 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 71/134] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:52 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:52.832515 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-c9c2c19e-99e0-4011-a102-321cba62547d tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:52.833962 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-c9c2c19e-99e0-4011-a102-321cba62547d tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d5e93419-e7dd-4cb3-9370-d46ec80bac7c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:52.841242 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c9c2c19e-99e0-4011-a102-321cba62547d tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:52.841897 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c9c2c19e-99e0-4011-a102-321cba62547d tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:52.842710 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c9c2c19e-99e0-4011-a102-321cba62547d tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:52.843143 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c9c2c19e-99e0-4011-a102-321cba62547d tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:52.846263 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:52.846263 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:52.947033 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-c9c2c19e-99e0-4011-a102-321cba62547d tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:52.949607 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:52.949607 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:52.956744 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-c9c2c19e-99e0-4011-a102-321cba62547d tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/d5e93419-e7dd-4cb3-9370-d46ec80bac7c" status: 200 len: 1278 microversion: 2.1 time: 0.128077 Jul 13 02:27:52.957482 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 72/135] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:52 2021] GET /compute/v2.1/servers/d5e93419-e7dd-4cb3-9370-d46ec80bac7c => generated 1278 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:27:53.017953 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-06806e5c-52c6-4536-955f-827fe35a1290 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:27:53.019286 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-06806e5c-52c6-4536-955f-827fe35a1290 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:53.025491 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-06806e5c-52c6-4536-955f-827fe35a1290 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:53.025938 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-06806e5c-52c6-4536-955f-827fe35a1290 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:53.026909 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-06806e5c-52c6-4536-955f-827fe35a1290 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:53.027337 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-06806e5c-52c6-4536-955f-827fe35a1290 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:53.030188 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:53.030188 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:55.122450 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-8f626275-ad17-4047-aa43-7d7495439749 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 200 len: 14 microversion: 2.1 time: 3.009550 Jul 13 02:27:55.123084 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 64/136] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:27:52 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 14 bytes in 3011 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 13 02:27:55.128369 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [req-7ef47e79-3fa2-49f1-b1f2-a9633d8e1587 req-84e73334-d7b5-44f3-9862-9aa57e1daa3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "872b8d83-fdcf-4888-b1d3-64f49541426d", "tag": "49588aa8-e16a-42d4-9d7e-8c1cf67a6211"}]} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:27:55.129978 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:27:55.129978 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: warnings.warn(msg) Jul 13 02:27:55.137525 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-7ef47e79-3fa2-49f1-b1f2-a9633d8e1587 req-84e73334-d7b5-44f3-9862-9aa57e1daa3f service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:55.138329 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-7ef47e79-3fa2-49f1-b1f2-a9633d8e1587 req-84e73334-d7b5-44f3-9862-9aa57e1daa3f service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:55.142540 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-06806e5c-52c6-4536-955f-827fe35a1290 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 14 microversion: 2.20 time: 2.127929 Jul 13 02:27:55.144184 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 73/137] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:27:53 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 14 bytes in 2131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:27:55.153396 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.compute.server_external_events [req-7ef47e79-3fa2-49f1-b1f2-a9633d8e1587 req-84e73334-d7b5-44f3-9862-9aa57e1daa3f service nova] Creating event network-changed:49588aa8-e16a-42d4-9d7e-8c1cf67a6211 for instance 872b8d83-fdcf-4888-b1d3-64f49541426d on hv-cinder-78102 Jul 13 02:27:55.158415 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-493d94f3-46e0-4a17-98f0-66794097c319 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:55.158601 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [req-7ef47e79-3fa2-49f1-b1f2-a9633d8e1587 req-84e73334-d7b5-44f3-9862-9aa57e1daa3f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033662 Jul 13 02:27:55.159237 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 65/138] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:27:55 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:27:55.159357 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-493d94f3-46e0-4a17-98f0-66794097c319 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:55.166296 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-2b77fb62-1ab9-4265-8314-1ed2209a7eb0 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:55.167311 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-2b77fb62-1ab9-4265-8314-1ed2209a7eb0 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d5e93419-e7dd-4cb3-9370-d46ec80bac7c] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:55.173916 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2b77fb62-1ab9-4265-8314-1ed2209a7eb0 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:55.174537 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2b77fb62-1ab9-4265-8314-1ed2209a7eb0 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:55.174712 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-493d94f3-46e0-4a17-98f0-66794097c319 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:55.175303 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-493d94f3-46e0-4a17-98f0-66794097c319 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:55.175451 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2b77fb62-1ab9-4265-8314-1ed2209a7eb0 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:55.175961 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2b77fb62-1ab9-4265-8314-1ed2209a7eb0 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:55.176101 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-493d94f3-46e0-4a17-98f0-66794097c319 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:55.176492 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-493d94f3-46e0-4a17-98f0-66794097c319 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:55.180233 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:55.180233 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:55.180445 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:55.180445 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:55.304317 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-2b77fb62-1ab9-4265-8314-1ed2209a7eb0 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:55.306942 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:55.306942 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:55.313806 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-2b77fb62-1ab9-4265-8314-1ed2209a7eb0 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/d5e93419-e7dd-4cb3-9370-d46ec80bac7c" status: 200 len: 1288 microversion: 2.1 time: 0.153020 Jul 13 02:27:55.314784 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 66/139] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:55 2021] GET /compute/v2.1/servers/d5e93419-e7dd-4cb3-9370-d46ec80bac7c => generated 1288 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:55.738221 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-493d94f3-46e0-4a17-98f0-66794097c319 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:55.741189 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:55.741189 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:55.748939 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-493d94f3-46e0-4a17-98f0-66794097c319 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1521 microversion: 2.1 time: 0.596830 Jul 13 02:27:55.748939 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 74/140] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:55 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1521 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:56.133020 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-127e995d-f8d7-4c46-ab47-38abeec43d5f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:27:56.134766 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-127e995d-f8d7-4c46-ab47-38abeec43d5f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:56.142226 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-127e995d-f8d7-4c46-ab47-38abeec43d5f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:56.143160 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-127e995d-f8d7-4c46-ab47-38abeec43d5f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:56.144013 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-127e995d-f8d7-4c46-ab47-38abeec43d5f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:56.144535 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-127e995d-f8d7-4c46-ab47-38abeec43d5f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:56.149455 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:56.149455 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:56.156081 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-2d88f95f-944c-4db3-a128-dcf6a3c69f5d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:27:56.157707 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-2d88f95f-944c-4db3-a128-dcf6a3c69f5d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:56.164532 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2d88f95f-944c-4db3-a128-dcf6a3c69f5d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:56.164971 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2d88f95f-944c-4db3-a128-dcf6a3c69f5d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:56.166019 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2d88f95f-944c-4db3-a128-dcf6a3c69f5d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:56.166623 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2d88f95f-944c-4db3-a128-dcf6a3c69f5d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:56.170249 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:56.170249 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:56.339323 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-127e995d-f8d7-4c46-ab47-38abeec43d5f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 200 len: 14 microversion: 2.1 time: 0.209942 Jul 13 02:27:56.348032 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 67/141] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:27:56 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 14 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 13 02:27:56.353895 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-5d0978fc-977f-4ca6-810d-0935a82b85aa tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:56.354808 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-5d0978fc-977f-4ca6-810d-0935a82b85aa tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d5e93419-e7dd-4cb3-9370-d46ec80bac7c] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:56.361486 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5d0978fc-977f-4ca6-810d-0935a82b85aa tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:56.365893 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5d0978fc-977f-4ca6-810d-0935a82b85aa tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:56.367438 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5d0978fc-977f-4ca6-810d-0935a82b85aa tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:56.368035 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5d0978fc-977f-4ca6-810d-0935a82b85aa tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:56.371673 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:56.371673 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:56.380488 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-2d88f95f-944c-4db3-a128-dcf6a3c69f5d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 14 microversion: 2.20 time: 0.228559 Jul 13 02:27:56.384979 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 75/142] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:27:56 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 14 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:56.734910 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-5d0978fc-977f-4ca6-810d-0935a82b85aa tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:56.738091 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:56.738091 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:56.745975 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-5d0978fc-977f-4ca6-810d-0935a82b85aa tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/d5e93419-e7dd-4cb3-9370-d46ec80bac7c" status: 200 len: 1318 microversion: 2.1 time: 0.396418 Jul 13 02:27:56.746581 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 68/143] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:56 2021] GET /compute/v2.1/servers/d5e93419-e7dd-4cb3-9370-d46ec80bac7c => generated 1318 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:56.766604 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-ade149e3-7142-4894-85ce-f7fc345a6c7c tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:56.767563 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-ade149e3-7142-4894-85ce-f7fc345a6c7c tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:56.776095 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ade149e3-7142-4894-85ce-f7fc345a6c7c tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:56.778762 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ade149e3-7142-4894-85ce-f7fc345a6c7c tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:56.782885 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ade149e3-7142-4894-85ce-f7fc345a6c7c tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:56.783404 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ade149e3-7142-4894-85ce-f7fc345a6c7c tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:56.786994 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:56.786994 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:57.077908 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-ade149e3-7142-4894-85ce-f7fc345a6c7c tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:27:57.080666 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:57.080666 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:27:57.089773 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-ade149e3-7142-4894-85ce-f7fc345a6c7c tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1521 microversion: 2.1 time: 0.328537 Jul 13 02:27:57.090635 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 76/144] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:27:56 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1521 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:27:57.220148 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-2b167a8b-87af-4e78-b3fa-25bc1162e8e6 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:27:57.220601 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-2b167a8b-87af-4e78-b3fa-25bc1162e8e6 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] [instance: cdd6e2b3-3294-448d-b390-4340eb1cf4fe] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:57.227121 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2b167a8b-87af-4e78-b3fa-25bc1162e8e6 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:57.227575 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2b167a8b-87af-4e78-b3fa-25bc1162e8e6 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:57.228351 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2b167a8b-87af-4e78-b3fa-25bc1162e8e6 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:57.228786 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2b167a8b-87af-4e78-b3fa-25bc1162e8e6 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:57.231848 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:57.231848 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:57.306556 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-2b167a8b-87af-4e78-b3fa-25bc1162e8e6 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] [instance: cdd6e2b3-3294-448d-b390-4340eb1cf4fe] Going to try to terminate instance {{(pid=107263) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 13 02:27:57.308947 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3008: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:57.308947 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).\ Jul 13 02:27:57.324645 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:57.324645 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:57.356220 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-428f35fa-02b8-40fe-8ed2-2637bb586a45 req-4b75cfc9-0ce5-465b-bf89-f8f19c0e1a4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5e93419-e7dd-4cb3-9370-d46ec80bac7c", "tag": "a3decc40-d384-449b-b7b0-9d10dd653354"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:27:57.358724 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:27:57.358724 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:27:57.368126 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-428f35fa-02b8-40fe-8ed2-2637bb586a45 req-4b75cfc9-0ce5-465b-bf89-f8f19c0e1a4f service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:57.368829 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-428f35fa-02b8-40fe-8ed2-2637bb586a45 req-4b75cfc9-0ce5-465b-bf89-f8f19c0e1a4f service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:57.386294 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/update_match.py:472: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:57.386294 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = query.session.execute(update_stmt) Jul 13 02:27:57.389242 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-428f35fa-02b8-40fe-8ed2-2637bb586a45 req-4b75cfc9-0ce5-465b-bf89-f8f19c0e1a4f service nova] Creating event network-changed:a3decc40-d384-449b-b7b0-9d10dd653354 for instance d5e93419-e7dd-4cb3-9370-d46ec80bac7c on hv-cinder-78102 Jul 13 02:27:57.394847 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-428f35fa-02b8-40fe-8ed2-2637bb586a45 req-4b75cfc9-0ce5-465b-bf89-f8f19c0e1a4f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046759 Jul 13 02:27:57.395660 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 77/145] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:27:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:27:57.401538 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-8523a1c3-1643-4339-ba76-b66876f92e5a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:27:57.402623 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-8523a1c3-1643-4339-ba76-b66876f92e5a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:57.406294 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:530: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:57.406294 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = model_query(context, models.Service, read_deleted="no").\ Jul 13 02:27:57.408867 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8523a1c3-1643-4339-ba76-b66876f92e5a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:57.409375 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8523a1c3-1643-4339-ba76-b66876f92e5a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:57.410394 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8523a1c3-1643-4339-ba76-b66876f92e5a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:57.410894 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8523a1c3-1643-4339-ba76-b66876f92e5a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:57.413862 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:57.413862 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:27:57.453507 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-2b167a8b-87af-4e78-b3fa-25bc1162e8e6 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] 10.222.0.32 "DELETE /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe" status: 204 len: 0 microversion: 2.1 time: 0.236818 Jul 13 02:27:57.454259 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 69/146] 10.222.0.32 () {58 vars in 1239 bytes} [Tue Jul 13 02:27:57 2021] DELETE /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 13 02:27:57.462185 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-221219dd-f031-43ab-bd7c-1ee790007bc2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:27:57.463889 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-221219dd-f031-43ab-bd7c-1ee790007bc2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:27:57.470816 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-221219dd-f031-43ab-bd7c-1ee790007bc2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:57.471440 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-221219dd-f031-43ab-bd7c-1ee790007bc2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:57.472540 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-221219dd-f031-43ab-bd7c-1ee790007bc2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:27:57.473248 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-221219dd-f031-43ab-bd7c-1ee790007bc2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:27:57.478760 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:27:57.478760 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:00.156372 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-221219dd-f031-43ab-bd7c-1ee790007bc2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 14 microversion: 2.20 time: 2.700209 Jul 13 02:28:00.157077 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 70/147] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:27:57 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 14 bytes in 2702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:00.162000 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-3f874d1f-3f53-4432-8a45-65bb620e5506 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:00.162756 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-3f874d1f-3f53-4432-8a45-65bb620e5506 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] [instance: cdd6e2b3-3294-448d-b390-4340eb1cf4fe] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:00.171098 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-3f874d1f-3f53-4432-8a45-65bb620e5506 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:00.171559 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-3f874d1f-3f53-4432-8a45-65bb620e5506 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:00.172339 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-3f874d1f-3f53-4432-8a45-65bb620e5506 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:00.172780 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-3f874d1f-3f53-4432-8a45-65bb620e5506 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:00.175962 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:00.175962 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:00.182334 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-8523a1c3-1643-4339-ba76-b66876f92e5a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 200 len: 14 microversion: 2.1 time: 2.785141 Jul 13 02:28:00.183602 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 78/148] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:27:57 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 14 bytes in 2787 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 13 02:28:00.192240 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-ad20ea9c-e408-4ae2-a9de-661b037a3684 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:00.193023 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-ad20ea9c-e408-4ae2-a9de-661b037a3684 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d5e93419-e7dd-4cb3-9370-d46ec80bac7c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:00.200069 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ad20ea9c-e408-4ae2-a9de-661b037a3684 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:00.200515 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ad20ea9c-e408-4ae2-a9de-661b037a3684 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:00.201278 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ad20ea9c-e408-4ae2-a9de-661b037a3684 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:00.201714 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ad20ea9c-e408-4ae2-a9de-661b037a3684 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:00.204697 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:00.204697 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:00.878349 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-3f874d1f-3f53-4432-8a45-65bb620e5506 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd9c7709a68475abdb5aba9f475b865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b02533417754144803237804ba3c72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:00.881449 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:00.881449 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:00.889688 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-3f874d1f-3f53-4432-8a45-65bb620e5506 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] 10.222.0.32 "GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe" status: 200 len: 1554 microversion: 2.1 time: 0.731333 Jul 13 02:28:00.891129 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 71/149] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:00 2021] GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe => generated 1554 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:00.895737 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-8eda9a5c-4852-4460-8819-0131f40f6b44 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:00.896520 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-8eda9a5c-4852-4460-8819-0131f40f6b44 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:00.904133 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8eda9a5c-4852-4460-8819-0131f40f6b44 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:00.904578 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8eda9a5c-4852-4460-8819-0131f40f6b44 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:00.905506 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8eda9a5c-4852-4460-8819-0131f40f6b44 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:00.906129 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8eda9a5c-4852-4460-8819-0131f40f6b44 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:00.909952 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:00.909952 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:00.916194 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-ad20ea9c-e408-4ae2-a9de-661b037a3684 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:00.918779 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:00.918779 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:00.936311 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-ad20ea9c-e408-4ae2-a9de-661b037a3684 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/d5e93419-e7dd-4cb3-9370-d46ec80bac7c" status: 200 len: 1318 microversion: 2.1 time: 0.744210 Jul 13 02:28:00.937321 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 79/150] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:00 2021] GET /compute/v2.1/servers/d5e93419-e7dd-4cb3-9370-d46ec80bac7c => generated 1318 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:01.168230 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-c3cc8f50-8565-45a6-b27e-ee8acc336e5e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:01.169394 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-c3cc8f50-8565-45a6-b27e-ee8acc336e5e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:01.170249 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-8eda9a5c-4852-4460-8819-0131f40f6b44 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:01.173213 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:01.173213 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:01.180122 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c3cc8f50-8565-45a6-b27e-ee8acc336e5e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:01.180574 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c3cc8f50-8565-45a6-b27e-ee8acc336e5e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:01.181365 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c3cc8f50-8565-45a6-b27e-ee8acc336e5e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:01.181815 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c3cc8f50-8565-45a6-b27e-ee8acc336e5e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:01.186371 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:01.186371 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:01.189917 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-8eda9a5c-4852-4460-8819-0131f40f6b44 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1521 microversion: 2.1 time: 0.297494 Jul 13 02:28:01.190739 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 72/151] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:00 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1521 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:01.198099 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-34d50d6c-035a-46da-84f5-cdd09fec2d62 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:01.203919 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-34d50d6c-035a-46da-84f5-cdd09fec2d62 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:01.218827 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-34d50d6c-035a-46da-84f5-cdd09fec2d62 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:01.219288 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-34d50d6c-035a-46da-84f5-cdd09fec2d62 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:01.220095 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-34d50d6c-035a-46da-84f5-cdd09fec2d62 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:01.220525 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-34d50d6c-035a-46da-84f5-cdd09fec2d62 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:01.224975 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:01.224975 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:01.476186 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-c3cc8f50-8565-45a6-b27e-ee8acc336e5e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 14 microversion: 2.20 time: 0.310958 Jul 13 02:28:01.479430 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 80/152] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:28:01 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 14 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:28:01.502626 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-34d50d6c-035a-46da-84f5-cdd09fec2d62 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 200 len: 14 microversion: 2.1 time: 0.308706 Jul 13 02:28:01.505718 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 73/153] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:28:01 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 14 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 13 02:28:01.908685 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-34497a2c-c34a-4429-8607-3fc02d0e5345 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:01.909333 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-34497a2c-c34a-4429-8607-3fc02d0e5345 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] [instance: cdd6e2b3-3294-448d-b390-4340eb1cf4fe] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:01.915800 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-34497a2c-c34a-4429-8607-3fc02d0e5345 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:01.916242 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-34497a2c-c34a-4429-8607-3fc02d0e5345 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:01.917006 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-34497a2c-c34a-4429-8607-3fc02d0e5345 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:01.917436 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-34497a2c-c34a-4429-8607-3fc02d0e5345 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:01.920337 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:01.920337 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:01.961118 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-1d266594-abf0-49df-83c9-0656ec88b601 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:01.961970 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-1d266594-abf0-49df-83c9-0656ec88b601 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d5e93419-e7dd-4cb3-9370-d46ec80bac7c] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:01.968499 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-1d266594-abf0-49df-83c9-0656ec88b601 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:01.969011 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-1d266594-abf0-49df-83c9-0656ec88b601 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:01.969912 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-1d266594-abf0-49df-83c9-0656ec88b601 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:01.970432 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-1d266594-abf0-49df-83c9-0656ec88b601 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:01.974138 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:01.974138 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:02.163568 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-34497a2c-c34a-4429-8607-3fc02d0e5345 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd9c7709a68475abdb5aba9f475b865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b02533417754144803237804ba3c72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:02.166417 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:02.166417 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:02.177132 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-34497a2c-c34a-4429-8607-3fc02d0e5345 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] 10.222.0.32 "GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe" status: 200 len: 1554 microversion: 2.1 time: 0.272447 Jul 13 02:28:02.177735 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 81/154] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:01 2021] GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe => generated 1554 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:02.207701 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-5138b321-495e-444c-9a8e-77b521b1909d tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:02.209096 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-5138b321-495e-444c-9a8e-77b521b1909d tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:02.216249 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5138b321-495e-444c-9a8e-77b521b1909d tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:02.216752 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5138b321-495e-444c-9a8e-77b521b1909d tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:02.217571 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5138b321-495e-444c-9a8e-77b521b1909d tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:02.218005 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5138b321-495e-444c-9a8e-77b521b1909d tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:02.221804 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:02.221804 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:02.228747 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-1d266594-abf0-49df-83c9-0656ec88b601 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:02.231462 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:02.231462 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:02.238979 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-1d266594-abf0-49df-83c9-0656ec88b601 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/d5e93419-e7dd-4cb3-9370-d46ec80bac7c" status: 200 len: 1318 microversion: 2.1 time: 0.289437 Jul 13 02:28:02.239606 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 74/155] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:01 2021] GET /compute/v2.1/servers/d5e93419-e7dd-4cb3-9370-d46ec80bac7c => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:28:02.397808 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-5138b321-495e-444c-9a8e-77b521b1909d tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:02.400480 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:02.400480 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:02.407318 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-5138b321-495e-444c-9a8e-77b521b1909d tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1521 microversion: 2.1 time: 0.203483 Jul 13 02:28:02.407887 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 82/156] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:02 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:28:02.487075 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-2264404c-d9ff-4f73-99be-5f588e78cdb9 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:02.488073 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-2264404c-d9ff-4f73-99be-5f588e78cdb9 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:02.494606 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2264404c-d9ff-4f73-99be-5f588e78cdb9 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:02.495071 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2264404c-d9ff-4f73-99be-5f588e78cdb9 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:02.495823 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2264404c-d9ff-4f73-99be-5f588e78cdb9 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:02.496260 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2264404c-d9ff-4f73-99be-5f588e78cdb9 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:02.498979 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:02.498979 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:02.513396 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-f639dc44-57ce-4c43-b941-8e63f9c1f5b8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:02.514327 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-f639dc44-57ce-4c43-b941-8e63f9c1f5b8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:02.520001 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f639dc44-57ce-4c43-b941-8e63f9c1f5b8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:02.520441 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f639dc44-57ce-4c43-b941-8e63f9c1f5b8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:02.521189 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f639dc44-57ce-4c43-b941-8e63f9c1f5b8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:02.521611 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f639dc44-57ce-4c43-b941-8e63f9c1f5b8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:02.524509 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:02.524509 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:05.333644 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-2264404c-d9ff-4f73-99be-5f588e78cdb9 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 14 microversion: 2.20 time: 2.850088 Jul 13 02:28:05.335156 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 75/157] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:28:02 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 14 bytes in 2852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:28:05.339945 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-aef7308c-d055-4bd1-a604-a6de8acae108 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:05.341138 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-aef7308c-d055-4bd1-a604-a6de8acae108 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] [instance: cdd6e2b3-3294-448d-b390-4340eb1cf4fe] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:05.347053 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-aef7308c-d055-4bd1-a604-a6de8acae108 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:05.347496 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-aef7308c-d055-4bd1-a604-a6de8acae108 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:05.348259 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-aef7308c-d055-4bd1-a604-a6de8acae108 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:05.348693 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-aef7308c-d055-4bd1-a604-a6de8acae108 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:05.352217 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:05.352217 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:05.370612 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-f639dc44-57ce-4c43-b941-8e63f9c1f5b8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 200 len: 11484 microversion: 2.1 time: 2.860791 Jul 13 02:28:05.371251 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 83/158] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:28:02 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 11484 bytes in 2862 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 13 02:28:05.376005 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-2d95a4f6-dcd6-4d7a-ac51-7e21a74a9282 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:05.376850 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-2d95a4f6-dcd6-4d7a-ac51-7e21a74a9282 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d5e93419-e7dd-4cb3-9370-d46ec80bac7c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:05.383163 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2d95a4f6-dcd6-4d7a-ac51-7e21a74a9282 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:05.383603 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2d95a4f6-dcd6-4d7a-ac51-7e21a74a9282 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:05.384363 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2d95a4f6-dcd6-4d7a-ac51-7e21a74a9282 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:05.384794 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2d95a4f6-dcd6-4d7a-ac51-7e21a74a9282 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:05.388055 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:05.388055 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:05.668048 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-aef7308c-d055-4bd1-a604-a6de8acae108 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd9c7709a68475abdb5aba9f475b865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b02533417754144803237804ba3c72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:05.670750 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:05.670750 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:05.680867 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-aef7308c-d055-4bd1-a604-a6de8acae108 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] 10.222.0.32 "GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe" status: 200 len: 1554 microversion: 2.1 time: 0.344687 Jul 13 02:28:05.692907 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 76/159] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:05 2021] GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe => generated 1554 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:05.700201 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-56ca0708-e90a-4bd4-b82c-5ca1db686e5f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:05.701061 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-56ca0708-e90a-4bd4-b82c-5ca1db686e5f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:05.707740 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-56ca0708-e90a-4bd4-b82c-5ca1db686e5f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:05.708195 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-56ca0708-e90a-4bd4-b82c-5ca1db686e5f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:05.708980 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-56ca0708-e90a-4bd4-b82c-5ca1db686e5f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:05.710062 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-56ca0708-e90a-4bd4-b82c-5ca1db686e5f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:05.714275 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:05.714275 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:05.726116 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-2d95a4f6-dcd6-4d7a-ac51-7e21a74a9282 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:05.731005 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:05.731005 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:05.743327 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-2d95a4f6-dcd6-4d7a-ac51-7e21a74a9282 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/d5e93419-e7dd-4cb3-9370-d46ec80bac7c" status: 200 len: 1318 microversion: 2.1 time: 0.370875 Jul 13 02:28:05.743951 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 84/160] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:05 2021] GET /compute/v2.1/servers/d5e93419-e7dd-4cb3-9370-d46ec80bac7c => generated 1318 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:05.988378 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-56ca0708-e90a-4bd4-b82c-5ca1db686e5f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:05.991501 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:05.991501 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:05.998973 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-56ca0708-e90a-4bd4-b82c-5ca1db686e5f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1521 microversion: 2.1 time: 0.304084 Jul 13 02:28:05.999544 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 77/161] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:05 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:06.344673 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-cb16256d-ad40-409b-978b-39f1914c80c9 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:06.345644 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-cb16256d-ad40-409b-978b-39f1914c80c9 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:06.352571 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-cb16256d-ad40-409b-978b-39f1914c80c9 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:06.353026 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-cb16256d-ad40-409b-978b-39f1914c80c9 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:06.353798 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-cb16256d-ad40-409b-978b-39f1914c80c9 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:06.354259 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-cb16256d-ad40-409b-978b-39f1914c80c9 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:06.356954 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:06.356954 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:06.381314 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-2fb58444-e4a5-4585-8f99-e63c77f406a3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:06.382351 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-2fb58444-e4a5-4585-8f99-e63c77f406a3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:06.388880 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2fb58444-e4a5-4585-8f99-e63c77f406a3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:06.389329 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2fb58444-e4a5-4585-8f99-e63c77f406a3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:06.390125 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2fb58444-e4a5-4585-8f99-e63c77f406a3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:06.390564 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2fb58444-e4a5-4585-8f99-e63c77f406a3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:06.393256 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:06.393256 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:06.591773 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-2fb58444-e4a5-4585-8f99-e63c77f406a3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 200 len: 14352 microversion: 2.1 time: 0.214025 Jul 13 02:28:06.592435 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 78/162] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:28:06 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 14352 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 13 02:28:06.607552 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-cb16256d-ad40-409b-978b-39f1914c80c9 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 14 microversion: 2.20 time: 0.266380 Jul 13 02:28:06.608820 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 85/163] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:28:06 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 14 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:06.700382 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-978de3ba-3646-4e3c-b3b1-bf0772476df5 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:06.701068 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-978de3ba-3646-4e3c-b3b1-bf0772476df5 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] [instance: cdd6e2b3-3294-448d-b390-4340eb1cf4fe] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:06.707459 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-978de3ba-3646-4e3c-b3b1-bf0772476df5 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:06.707907 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-978de3ba-3646-4e3c-b3b1-bf0772476df5 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:06.708664 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-978de3ba-3646-4e3c-b3b1-bf0772476df5 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:06.709092 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-978de3ba-3646-4e3c-b3b1-bf0772476df5 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:06.713184 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:06.713184 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:06.760781 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-7cedec9c-e6fd-4420-8348-b84992188db1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:06.761883 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-7cedec9c-e6fd-4420-8348-b84992188db1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d5e93419-e7dd-4cb3-9370-d46ec80bac7c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:06.769115 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7cedec9c-e6fd-4420-8348-b84992188db1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:06.769827 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7cedec9c-e6fd-4420-8348-b84992188db1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:06.770749 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7cedec9c-e6fd-4420-8348-b84992188db1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:06.771292 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7cedec9c-e6fd-4420-8348-b84992188db1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:06.775233 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:06.775233 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:07.119144 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-978de3ba-3646-4e3c-b3b1-bf0772476df5 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd9c7709a68475abdb5aba9f475b865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b02533417754144803237804ba3c72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:07.121923 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:07.121923 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:07.129278 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-978de3ba-3646-4e3c-b3b1-bf0772476df5 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] 10.222.0.32 "GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe" status: 200 len: 1554 microversion: 2.1 time: 0.432884 Jul 13 02:28:07.129857 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 79/164] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:06 2021] GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe => generated 1554 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:07.134574 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-1bbdd8cb-fc1e-4da3-a599-24b39f528107 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:07.135175 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-1bbdd8cb-fc1e-4da3-a599-24b39f528107 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:07.141348 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-1bbdd8cb-fc1e-4da3-a599-24b39f528107 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:07.141800 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-1bbdd8cb-fc1e-4da3-a599-24b39f528107 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:07.142598 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-1bbdd8cb-fc1e-4da3-a599-24b39f528107 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:07.143037 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-1bbdd8cb-fc1e-4da3-a599-24b39f528107 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:07.145920 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:07.145920 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:07.168198 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-7cedec9c-e6fd-4420-8348-b84992188db1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:07.172763 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:07.172763 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:07.185570 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-7cedec9c-e6fd-4420-8348-b84992188db1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/d5e93419-e7dd-4cb3-9370-d46ec80bac7c" status: 200 len: 1318 microversion: 2.1 time: 0.428722 Jul 13 02:28:07.186528 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 86/165] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:06 2021] GET /compute/v2.1/servers/d5e93419-e7dd-4cb3-9370-d46ec80bac7c => generated 1318 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:28:07.443306 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-b0ab8fb2-7e6d-4012-9a80-831e1052bec3 req-6a54b8dd-4126-4920-a084-d7a036644738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdd6e2b3-3294-448d-b390-4340eb1cf4fe", "name": "network-vif-deleted", "tag": "a8589fd5-f6a3-4169-9e78-c802007a1513"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:07.445340 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:28:07.445340 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:28:07.451337 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-1bbdd8cb-fc1e-4da3-a599-24b39f528107 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:07.453987 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-b0ab8fb2-7e6d-4012-9a80-831e1052bec3 req-6a54b8dd-4126-4920-a084-d7a036644738 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:07.454399 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:07.454399 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:07.454586 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-b0ab8fb2-7e6d-4012-9a80-831e1052bec3 req-6a54b8dd-4126-4920-a084-d7a036644738 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:07.464387 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-1bbdd8cb-fc1e-4da3-a599-24b39f528107 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1521 microversion: 2.1 time: 0.333399 Jul 13 02:28:07.465125 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 80/166] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:07 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1521 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:07.468551 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-b0ab8fb2-7e6d-4012-9a80-831e1052bec3 req-6a54b8dd-4126-4920-a084-d7a036644738 service nova] Creating event network-vif-deleted:a8589fd5-f6a3-4169-9e78-c802007a1513 for instance cdd6e2b3-3294-448d-b390-4340eb1cf4fe on hv-cinder-78102 Jul 13 02:28:07.474624 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-b0ab8fb2-7e6d-4012-9a80-831e1052bec3 req-6a54b8dd-4126-4920-a084-d7a036644738 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034854 Jul 13 02:28:07.475850 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 87/167] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:28:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 02:28:07.604307 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-086a30ff-8dbb-4b3e-814c-1c51edd92194 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:07.605100 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-086a30ff-8dbb-4b3e-814c-1c51edd92194 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:07.610748 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-086a30ff-8dbb-4b3e-814c-1c51edd92194 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:07.611190 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-086a30ff-8dbb-4b3e-814c-1c51edd92194 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:07.611958 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-086a30ff-8dbb-4b3e-814c-1c51edd92194 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:07.612393 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-086a30ff-8dbb-4b3e-814c-1c51edd92194 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:07.615266 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:07.615266 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:07.619171 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-f658eb82-deea-4e8c-910f-474405fefcd5 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:07.620516 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-f658eb82-deea-4e8c-910f-474405fefcd5 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:07.626798 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f658eb82-deea-4e8c-910f-474405fefcd5 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:07.627306 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f658eb82-deea-4e8c-910f-474405fefcd5 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:07.628164 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f658eb82-deea-4e8c-910f-474405fefcd5 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:07.628774 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f658eb82-deea-4e8c-910f-474405fefcd5 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:07.631634 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:07.631634 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:10.568898 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-086a30ff-8dbb-4b3e-814c-1c51edd92194 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 200 len: 19342 microversion: 2.1 time: 2.969309 Jul 13 02:28:10.570073 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 81/168] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:28:07 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 19342 bytes in 2971 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:28:10.574875 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-dcd3fed3-78ac-401c-a315-9ef0488d7197 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:10.575578 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-dcd3fed3-78ac-401c-a315-9ef0488d7197 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] [instance: cdd6e2b3-3294-448d-b390-4340eb1cf4fe] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:10.582083 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-dcd3fed3-78ac-401c-a315-9ef0488d7197 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:10.582534 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-dcd3fed3-78ac-401c-a315-9ef0488d7197 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:10.583413 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-dcd3fed3-78ac-401c-a315-9ef0488d7197 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:10.583853 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-dcd3fed3-78ac-401c-a315-9ef0488d7197 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:10.587202 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-f658eb82-deea-4e8c-910f-474405fefcd5 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 14 microversion: 2.20 time: 2.972148 Jul 13 02:28:10.587773 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:10.587773 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:10.588165 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 88/169] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:28:07 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 14 bytes in 2974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:28:10.593417 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-ba76ba67-c641-4717-b33a-122a1cdce29b tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:10.594141 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-ba76ba67-c641-4717-b33a-122a1cdce29b tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d5e93419-e7dd-4cb3-9370-d46ec80bac7c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:10.601791 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ba76ba67-c641-4717-b33a-122a1cdce29b tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:10.602263 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ba76ba67-c641-4717-b33a-122a1cdce29b tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:10.603036 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ba76ba67-c641-4717-b33a-122a1cdce29b tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:10.603465 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ba76ba67-c641-4717-b33a-122a1cdce29b tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:10.606449 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:10.606449 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:10.692310 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-dcd3fed3-78ac-401c-a315-9ef0488d7197 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd9c7709a68475abdb5aba9f475b865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b02533417754144803237804ba3c72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:10.695148 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:10.695148 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:10.703194 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-dcd3fed3-78ac-401c-a315-9ef0488d7197 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] 10.222.0.32 "GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe" status: 200 len: 1346 microversion: 2.1 time: 0.132210 Jul 13 02:28:10.703792 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 82/170] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:10 2021] GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe => generated 1346 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:10.709128 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-eb1c83e3-db90-47a7-910f-5dce34ae32ca tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:10.710270 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-eb1c83e3-db90-47a7-910f-5dce34ae32ca tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:10.715910 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-eb1c83e3-db90-47a7-910f-5dce34ae32ca tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:10.716358 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-eb1c83e3-db90-47a7-910f-5dce34ae32ca tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:10.717122 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-eb1c83e3-db90-47a7-910f-5dce34ae32ca tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:10.717561 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-eb1c83e3-db90-47a7-910f-5dce34ae32ca tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:10.720566 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:10.720566 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:10.794112 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-ba76ba67-c641-4717-b33a-122a1cdce29b tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:10.796667 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:10.796667 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:10.803669 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-ba76ba67-c641-4717-b33a-122a1cdce29b tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/d5e93419-e7dd-4cb3-9370-d46ec80bac7c" status: 200 len: 1318 microversion: 2.1 time: 0.214088 Jul 13 02:28:10.804333 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 89/171] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:10 2021] GET /compute/v2.1/servers/d5e93419-e7dd-4cb3-9370-d46ec80bac7c => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:10.897706 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-eb1c83e3-db90-47a7-910f-5dce34ae32ca tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:10.900468 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:10.900468 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:10.907228 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-eb1c83e3-db90-47a7-910f-5dce34ae32ca tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1521 microversion: 2.1 time: 0.202059 Jul 13 02:28:10.907785 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 83/172] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:10 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:11.560337 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-f4bdbf45-72e8-4421-b92c-0f31e8ba633b tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-507688124", "imageRef": "1a3efd47-3618-4abd-b00b-a9fa9b90b4d4", "flavorRef": "452", "networks": [{"uuid": "889ba6c6-2035-4ca1-b73e-b7767234c4d9"}]}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:11.581906 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-ffbb0811-727b-4ea8-8621-5389cb2a4124 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:11.583014 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-ffbb0811-727b-4ea8-8621-5389cb2a4124 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:11.590292 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ffbb0811-727b-4ea8-8621-5389cb2a4124 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:11.590885 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ffbb0811-727b-4ea8-8621-5389cb2a4124 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:11.593410 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ffbb0811-727b-4ea8-8621-5389cb2a4124 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:11.593410 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ffbb0811-727b-4ea8-8621-5389cb2a4124 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:11.595451 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:11.595451 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:11.618473 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.network.neutron [None req-f4bdbf45-72e8-4421-b92c-0f31e8ba633b tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] validate_networks() for [('889ba6c6-2035-4ca1-b73e-b7767234c4d9', None, None, None)] {{(pid=107262) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Jul 13 02:28:11.763352 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-ffbb0811-727b-4ea8-8621-5389cb2a4124 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 200 len: 20997 microversion: 2.1 time: 0.185379 Jul 13 02:28:11.763955 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 84/173] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:28:11 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 20997 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 13 02:28:11.769284 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-32ffc97e-6032-4b27-9a25-9a62e7d17c52 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:11.770322 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-32ffc97e-6032-4b27-9a25-9a62e7d17c52 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:11.777591 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-32ffc97e-6032-4b27-9a25-9a62e7d17c52 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:11.778084 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-32ffc97e-6032-4b27-9a25-9a62e7d17c52 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:11.778855 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-32ffc97e-6032-4b27-9a25-9a62e7d17c52 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:11.779283 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-32ffc97e-6032-4b27-9a25-9a62e7d17c52 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:11.782269 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:11.782269 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:11.956480 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-f4bdbf45-72e8-4421-b92c-0f31e8ba633b tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Flavor limits 0:0:0 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 02:28:11.957091 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-f4bdbf45-72e8-4421-b92c-0f31e8ba633b tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Image limits 0:0:0 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 02:28:11.957733 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-f4bdbf45-72e8-4421-b92c-0f31e8ba633b tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Flavor pref 0:0:0 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 02:28:11.958172 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-f4bdbf45-72e8-4421-b92c-0f31e8ba633b tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Image pref 0:0:0 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 02:28:11.958579 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-f4bdbf45-72e8-4421-b92c-0f31e8ba633b tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 02:28:11.963014 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-32ffc97e-6032-4b27-9a25-9a62e7d17c52 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 14 microversion: 2.20 time: 0.197591 Jul 13 02:28:11.963679 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 85/174] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:28:11 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 14 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:11.964648 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2690: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:11.964648 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: user_quotas = model_query(context, models.ProjectUserQuota, Jul 13 02:28:11.968971 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f4bdbf45-72e8-4421-b92c-0f31e8ba633b tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:11.969525 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f4bdbf45-72e8-4421-b92c-0f31e8ba633b tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:11.970003 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-ebc52a62-cf04-473e-8b1d-946bde45731c tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:11.970560 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f4bdbf45-72e8-4421-b92c-0f31e8ba633b tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:11.970720 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-ebc52a62-cf04-473e-8b1d-946bde45731c tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] [instance: cdd6e2b3-3294-448d-b390-4340eb1cf4fe] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:11.971199 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f4bdbf45-72e8-4421-b92c-0f31e8ba633b tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:11.976567 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/objects/instance.py:1537: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:11.976567 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: project_result = project_query.first() Jul 13 02:28:11.978174 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ebc52a62-cf04-473e-8b1d-946bde45731c tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:11.978699 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ebc52a62-cf04-473e-8b1d-946bde45731c tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:11.979638 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ebc52a62-cf04-473e-8b1d-946bde45731c tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:11.980203 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ebc52a62-cf04-473e-8b1d-946bde45731c tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:11.983716 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:11.983716 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:11.989936 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2708: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:11.989936 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: rows = model_query(context, models.Quota, read_deleted="no").\ Jul 13 02:28:11.994461 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.quota [None req-f4bdbf45-72e8-4421-b92c-0f31e8ba633b tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Getting quotas for project eaa2c1d46685432e8656123be9d86664. Resources: {'ram', 'cores', 'instances'} {{(pid=107262) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 13 02:28:11.998548 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.quota [None req-f4bdbf45-72e8-4421-b92c-0f31e8ba633b tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Getting quotas for user 21025e2c8aa9423dbd05da95f237b481 and project eaa2c1d46685432e8656123be9d86664. Resources: {'ram', 'cores', 'instances'} {{(pid=107262) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 13 02:28:12.018125 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-f4bdbf45-72e8-4421-b92c-0f31e8ba633b tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Going to run 1 instances... {{(pid=107262) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 13 02:28:12.020435 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-f4bdbf45-72e8-4421-b92c-0f31e8ba633b tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 97a3e7df-5271-4585-b962-e014adc2c87b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a3efd47-3618-4abd-b00b-a9fa9b90b4d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107262) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 13 02:28:12.057223 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ebc52a62-cf04-473e-8b1d-946bde45731c tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:12.057718 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ebc52a62-cf04-473e-8b1d-946bde45731c tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:12.058238 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.objects.instance [None req-ebc52a62-cf04-473e-8b1d-946bde45731c tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lazy-loading 'fault' on Instance uuid cdd6e2b3-3294-448d-b390-4340eb1cf4fe {{(pid=107263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 13 02:28:12.060493 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:4002: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:12.060493 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: for row in query: Jul 13 02:28:12.065027 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-f4bdbf45-72e8-4421-b92c-0f31e8ba633b tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.508253 Jul 13 02:28:12.066227 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 90/175] 10.222.0.32 () {60 vars in 1147 bytes} [Tue Jul 13 02:28:11 2021] POST /compute/v2.1/servers => generated 380 bytes in 510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 02:28:12.071970 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-6bbf1b08-3845-4e24-bcc0-d856d59b4adc tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:12.072763 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-6bbf1b08-3845-4e24-bcc0-d856d59b4adc tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d5e93419-e7dd-4cb3-9370-d46ec80bac7c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:12.079610 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-6bbf1b08-3845-4e24-bcc0-d856d59b4adc tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:12.080282 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-6bbf1b08-3845-4e24-bcc0-d856d59b4adc tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:12.081255 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-6bbf1b08-3845-4e24-bcc0-d856d59b4adc tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:12.081842 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-6bbf1b08-3845-4e24-bcc0-d856d59b4adc tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:12.086346 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:12.086346 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:12.116463 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-ebc52a62-cf04-473e-8b1d-946bde45731c tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2fd9c7709a68475abdb5aba9f475b865', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b02533417754144803237804ba3c72d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:12.119512 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:12.119512 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:12.127394 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-ebc52a62-cf04-473e-8b1d-946bde45731c tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] 10.222.0.32 "GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe" status: 200 len: 1351 microversion: 2.1 time: 0.162102 Jul 13 02:28:12.127976 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 86/176] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:11 2021] GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe => generated 1351 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:12.133249 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-b9f4adfd-c415-4206-90f6-cbad1d39e98e tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:12.134009 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-b9f4adfd-c415-4206-90f6-cbad1d39e98e tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:12.140413 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b9f4adfd-c415-4206-90f6-cbad1d39e98e tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:12.141045 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b9f4adfd-c415-4206-90f6-cbad1d39e98e tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:12.142013 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b9f4adfd-c415-4206-90f6-cbad1d39e98e tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:12.142649 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b9f4adfd-c415-4206-90f6-cbad1d39e98e tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:12.146071 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:12.146071 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:12.381067 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-6bbf1b08-3845-4e24-bcc0-d856d59b4adc tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:12.390245 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:12.390245 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:12.391220 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-b9f4adfd-c415-4206-90f6-cbad1d39e98e tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:12.393719 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:12.393719 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:12.405059 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-b9f4adfd-c415-4206-90f6-cbad1d39e98e tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1521 microversion: 2.1 time: 0.273064 Jul 13 02:28:12.407332 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-6bbf1b08-3845-4e24-bcc0-d856d59b4adc tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/d5e93419-e7dd-4cb3-9370-d46ec80bac7c" status: 200 len: 1318 microversion: 2.1 time: 0.339828 Jul 13 02:28:12.408413 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 91/177] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:12 2021] GET /compute/v2.1/servers/d5e93419-e7dd-4cb3-9370-d46ec80bac7c => generated 1318 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:12.414695 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-59557ebe-83d9-46e5-88c5-37d57a22b624 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:12.415990 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-59557ebe-83d9-46e5-88c5-37d57a22b624 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 97a3e7df-5271-4585-b962-e014adc2c87b] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:12.417970 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 87/178] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:12 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:12.480039 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-59557ebe-83d9-46e5-88c5-37d57a22b624 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21025e2c8aa9423dbd05da95f237b481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2c1d46685432e8656123be9d86664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:12.483639 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:12.483639 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:12.490826 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-59557ebe-83d9-46e5-88c5-37d57a22b624 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "GET /compute/v2.1/servers/97a3e7df-5271-4585-b962-e014adc2c87b" status: 200 len: 1218 microversion: 2.1 time: 0.081043 Jul 13 02:28:12.500110 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 92/179] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:12 2021] GET /compute/v2.1/servers/97a3e7df-5271-4585-b962-e014adc2c87b => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:12.708295 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [req-66b14933-cdeb-430f-99dc-1bbb808eefc1 req-ab66bba0-844c-4a0a-b1f7-fd50a0262dd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5e93419-e7dd-4cb3-9370-d46ec80bac7c", "name": "network-vif-plugged", "status": "completed", "tag": "a3decc40-d384-449b-b7b0-9d10dd653354"}]} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:12.710203 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:28:12.710203 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: warnings.warn(msg) Jul 13 02:28:12.718443 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-66b14933-cdeb-430f-99dc-1bbb808eefc1 req-ab66bba0-844c-4a0a-b1f7-fd50a0262dd7 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:12.718898 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-66b14933-cdeb-430f-99dc-1bbb808eefc1 req-ab66bba0-844c-4a0a-b1f7-fd50a0262dd7 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:12.730271 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.compute.server_external_events [req-66b14933-cdeb-430f-99dc-1bbb808eefc1 req-ab66bba0-844c-4a0a-b1f7-fd50a0262dd7 service nova] Creating event network-vif-plugged:a3decc40-d384-449b-b7b0-9d10dd653354 for instance d5e93419-e7dd-4cb3-9370-d46ec80bac7c on hv-cinder-78102 Jul 13 02:28:12.734988 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [req-66b14933-cdeb-430f-99dc-1bbb808eefc1 req-ab66bba0-844c-4a0a-b1f7-fd50a0262dd7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030366 Jul 13 02:28:12.736051 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 88/180] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:28:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:28:12.774892 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-f1eac653-2c92-4aad-bcf9-63b3409827fc tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:12.775676 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-f1eac653-2c92-4aad-bcf9-63b3409827fc tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:12.781516 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f1eac653-2c92-4aad-bcf9-63b3409827fc tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:12.782212 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f1eac653-2c92-4aad-bcf9-63b3409827fc tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:12.783311 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f1eac653-2c92-4aad-bcf9-63b3409827fc tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:12.783886 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f1eac653-2c92-4aad-bcf9-63b3409827fc tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:12.788629 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:12.788629 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:12.974775 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-d78cf56e-4284-4304-83c2-e095f1f6ae81 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:12.976399 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-d78cf56e-4284-4304-83c2-e095f1f6ae81 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:12.982425 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d78cf56e-4284-4304-83c2-e095f1f6ae81 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:12.982876 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d78cf56e-4284-4304-83c2-e095f1f6ae81 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:12.983636 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d78cf56e-4284-4304-83c2-e095f1f6ae81 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:12.984177 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d78cf56e-4284-4304-83c2-e095f1f6ae81 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:12.986915 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:12.986915 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:16.060235 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-f1eac653-2c92-4aad-bcf9-63b3409827fc tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 200 len: 24455 microversion: 2.1 time: 3.289159 Jul 13 02:28:16.060901 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 93/181] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:28:12 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 24455 bytes in 3291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:28:16.066619 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-e1f090f0-8801-4a97-bbcf-360104b8befb tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:16.067352 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-e1f090f0-8801-4a97-bbcf-360104b8befb tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] [instance: cdd6e2b3-3294-448d-b390-4340eb1cf4fe] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:16.074580 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e1f090f0-8801-4a97-bbcf-360104b8befb tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:16.075081 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e1f090f0-8801-4a97-bbcf-360104b8befb tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:16.075882 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e1f090f0-8801-4a97-bbcf-360104b8befb tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:16.076320 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e1f090f0-8801-4a97-bbcf-360104b8befb tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:16.079186 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:16.079186 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:16.096156 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-d78cf56e-4284-4304-83c2-e095f1f6ae81 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 15064 microversion: 2.20 time: 3.125725 Jul 13 02:28:16.096855 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 89/182] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:28:12 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 15064 bytes in 3128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 13 02:28:16.101970 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-1c397752-6673-4a8e-b746-4db8e31f4489 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:16.102686 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-1c397752-6673-4a8e-b746-4db8e31f4489 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d5e93419-e7dd-4cb3-9370-d46ec80bac7c] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:16.108929 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-1c397752-6673-4a8e-b746-4db8e31f4489 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:16.109381 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-1c397752-6673-4a8e-b746-4db8e31f4489 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:16.110182 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-1c397752-6673-4a8e-b746-4db8e31f4489 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:16.110624 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-1c397752-6673-4a8e-b746-4db8e31f4489 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:16.113551 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:16.113551 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:16.124715 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.wsgi [None req-e1f090f0-8801-4a97-bbcf-360104b8befb tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] HTTP exception thrown: Instance cdd6e2b3-3294-448d-b390-4340eb1cf4fe could not be found. Jul 13 02:28:16.125318 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-e1f090f0-8801-4a97-bbcf-360104b8befb tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Returning 404 to user: Instance cdd6e2b3-3294-448d-b390-4340eb1cf4fe could not be found. {{(pid=107262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:28:16.126192 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-e1f090f0-8801-4a97-bbcf-360104b8befb tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] 10.222.0.32 "GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe" status: 404 len: 111 microversion: 2.1 time: 0.064206 Jul 13 02:28:16.129725 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 94/183] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:16 2021] GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 02:28:16.132543 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-05c5223b-c8de-4c0b-b13d-515bcd384333 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:16.133427 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-05c5223b-c8de-4c0b-b13d-515bcd384333 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:16.141864 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-05c5223b-c8de-4c0b-b13d-515bcd384333 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:16.143481 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-05c5223b-c8de-4c0b-b13d-515bcd384333 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:16.143481 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-05c5223b-c8de-4c0b-b13d-515bcd384333 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:16.143718 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-05c5223b-c8de-4c0b-b13d-515bcd384333 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:16.146904 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:16.146904 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:16.362449 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-1c397752-6673-4a8e-b746-4db8e31f4489 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:16.369845 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:16.369845 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:16.376995 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-1c397752-6673-4a8e-b746-4db8e31f4489 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/d5e93419-e7dd-4cb3-9370-d46ec80bac7c" status: 200 len: 1318 microversion: 2.1 time: 0.278918 Jul 13 02:28:16.377576 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 90/184] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:16 2021] GET /compute/v2.1/servers/d5e93419-e7dd-4cb3-9370-d46ec80bac7c => generated 1318 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:16.382395 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-116c5c83-5da9-45d4-801e-93b290051769 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:16.383003 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-116c5c83-5da9-45d4-801e-93b290051769 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 97a3e7df-5271-4585-b962-e014adc2c87b] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:16.390137 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-116c5c83-5da9-45d4-801e-93b290051769 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:16.390584 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-116c5c83-5da9-45d4-801e-93b290051769 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:16.391365 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-116c5c83-5da9-45d4-801e-93b290051769 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:16.391969 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-116c5c83-5da9-45d4-801e-93b290051769 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:16.393587 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-05c5223b-c8de-4c0b-b13d-515bcd384333 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:16.395854 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:16.395854 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:16.397119 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:16.397119 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:16.411837 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-05c5223b-c8de-4c0b-b13d-515bcd384333 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1521 microversion: 2.1 time: 0.284015 Jul 13 02:28:16.422132 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 95/185] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:16 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:16.500056 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-116c5c83-5da9-45d4-801e-93b290051769 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21025e2c8aa9423dbd05da95f237b481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2c1d46685432e8656123be9d86664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:16.503017 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:16.503017 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:16.509919 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-116c5c83-5da9-45d4-801e-93b290051769 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "GET /compute/v2.1/servers/97a3e7df-5271-4585-b962-e014adc2c87b" status: 200 len: 1270 microversion: 2.1 time: 0.130926 Jul 13 02:28:16.510518 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 91/186] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:16 2021] GET /compute/v2.1/servers/97a3e7df-5271-4585-b962-e014adc2c87b => generated 1270 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:17.073626 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-8d4d5129-08bf-4a79-bb1a-02f155642d98 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:17.075650 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-8d4d5129-08bf-4a79-bb1a-02f155642d98 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:17.082438 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8d4d5129-08bf-4a79-bb1a-02f155642d98 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:17.083152 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8d4d5129-08bf-4a79-bb1a-02f155642d98 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:17.084145 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8d4d5129-08bf-4a79-bb1a-02f155642d98 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:17.084786 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8d4d5129-08bf-4a79-bb1a-02f155642d98 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:17.089198 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:17.089198 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:17.108385 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-2b076949-77e7-42f6-ae38-31b877913535 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:17.109541 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-2b076949-77e7-42f6-ae38-31b877913535 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:17.122642 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2b076949-77e7-42f6-ae38-31b877913535 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:17.123425 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2b076949-77e7-42f6-ae38-31b877913535 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:17.124401 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2b076949-77e7-42f6-ae38-31b877913535 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:17.125028 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2b076949-77e7-42f6-ae38-31b877913535 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:17.128437 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:17.128437 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:17.313253 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-8d4d5129-08bf-4a79-bb1a-02f155642d98 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 200 len: 25053 microversion: 2.1 time: 0.245396 Jul 13 02:28:17.314101 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 96/187] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:28:17 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 25053 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:28:17.346465 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-2b076949-77e7-42f6-ae38-31b877913535 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 17498 microversion: 2.20 time: 0.241505 Jul 13 02:28:17.347915 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 92/188] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:28:17 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 17498 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 13 02:28:17.394836 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-3d0331cc-398b-4bda-8688-b1011e58b42c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:17.395566 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-3d0331cc-398b-4bda-8688-b1011e58b42c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d5e93419-e7dd-4cb3-9370-d46ec80bac7c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:17.403274 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3d0331cc-398b-4bda-8688-b1011e58b42c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:17.403720 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3d0331cc-398b-4bda-8688-b1011e58b42c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:17.404497 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3d0331cc-398b-4bda-8688-b1011e58b42c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:17.405419 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3d0331cc-398b-4bda-8688-b1011e58b42c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:17.408417 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:17.408417 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:17.430872 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-0ce79657-79d1-430d-9cf1-73d73b897d05 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:17.431807 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-0ce79657-79d1-430d-9cf1-73d73b897d05 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:17.442380 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0ce79657-79d1-430d-9cf1-73d73b897d05 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:17.443701 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0ce79657-79d1-430d-9cf1-73d73b897d05 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:17.444979 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0ce79657-79d1-430d-9cf1-73d73b897d05 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:17.446324 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0ce79657-79d1-430d-9cf1-73d73b897d05 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:17.451754 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:17.451754 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:17.766492 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-3d0331cc-398b-4bda-8688-b1011e58b42c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:17.769125 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:17.769125 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:17.776873 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-3d0331cc-398b-4bda-8688-b1011e58b42c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/d5e93419-e7dd-4cb3-9370-d46ec80bac7c" status: 200 len: 1318 microversion: 2.1 time: 0.386075 Jul 13 02:28:17.777833 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 97/189] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:17 2021] GET /compute/v2.1/servers/d5e93419-e7dd-4cb3-9370-d46ec80bac7c => generated 1318 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:17.782137 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-ba2f26b9-c5c6-4597-b394-4d2c8b223b09 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:17.782696 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-ba2f26b9-c5c6-4597-b394-4d2c8b223b09 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] [instance: cdd6e2b3-3294-448d-b390-4340eb1cf4fe] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:17.788879 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ba2f26b9-c5c6-4597-b394-4d2c8b223b09 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:17.789390 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ba2f26b9-c5c6-4597-b394-4d2c8b223b09 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:17.790277 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ba2f26b9-c5c6-4597-b394-4d2c8b223b09 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:17.790772 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ba2f26b9-c5c6-4597-b394-4d2c8b223b09 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:17.793904 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:17.793904 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:17.794119 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-0ce79657-79d1-430d-9cf1-73d73b897d05 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:17.796850 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:17.796850 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:17.805340 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-0ce79657-79d1-430d-9cf1-73d73b897d05 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1521 microversion: 2.1 time: 0.380217 Jul 13 02:28:17.814394 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 93/190] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:17 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1521 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:28:17.814394 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-588b132e-a175-4061-af2e-ac2cd213986b tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:17.814394 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-588b132e-a175-4061-af2e-ac2cd213986b tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 97a3e7df-5271-4585-b962-e014adc2c87b] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:17.821986 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-588b132e-a175-4061-af2e-ac2cd213986b tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:17.823074 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-588b132e-a175-4061-af2e-ac2cd213986b tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:17.823938 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-588b132e-a175-4061-af2e-ac2cd213986b tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:17.824502 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-588b132e-a175-4061-af2e-ac2cd213986b tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:17.827906 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:17.827906 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:17.841592 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.wsgi [None req-ba2f26b9-c5c6-4597-b394-4d2c8b223b09 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] HTTP exception thrown: Instance cdd6e2b3-3294-448d-b390-4340eb1cf4fe could not be found. Jul 13 02:28:17.842319 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-ba2f26b9-c5c6-4597-b394-4d2c8b223b09 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Returning 404 to user: Instance cdd6e2b3-3294-448d-b390-4340eb1cf4fe could not be found. {{(pid=107262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:28:17.843370 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-ba2f26b9-c5c6-4597-b394-4d2c8b223b09 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] 10.222.0.32 "DELETE /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe" status: 404 len: 111 microversion: 2.1 time: 0.064547 Jul 13 02:28:17.847040 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 98/191] 10.222.0.32 () {58 vars in 1239 bytes} [Tue Jul 13 02:28:17 2021] DELETE /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 02:28:17.851880 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-d554c99f-a76d-4eb9-85b2-7c53eb4fd054 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:17.852566 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-d554c99f-a76d-4eb9-85b2-7c53eb4fd054 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] [instance: cdd6e2b3-3294-448d-b390-4340eb1cf4fe] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:17.859814 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d554c99f-a76d-4eb9-85b2-7c53eb4fd054 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:17.860270 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d554c99f-a76d-4eb9-85b2-7c53eb4fd054 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:17.861047 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d554c99f-a76d-4eb9-85b2-7c53eb4fd054 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:17.862010 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d554c99f-a76d-4eb9-85b2-7c53eb4fd054 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:17.864773 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:17.864773 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:17.920493 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.wsgi [None req-d554c99f-a76d-4eb9-85b2-7c53eb4fd054 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] HTTP exception thrown: Instance cdd6e2b3-3294-448d-b390-4340eb1cf4fe could not be found. Jul 13 02:28:17.921102 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-d554c99f-a76d-4eb9-85b2-7c53eb4fd054 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] Returning 404 to user: Instance cdd6e2b3-3294-448d-b390-4340eb1cf4fe could not be found. {{(pid=107262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:28:17.922011 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-d554c99f-a76d-4eb9-85b2-7c53eb4fd054 tempest-DeleteServersTestJSON-421021850 tempest-DeleteServersTestJSON-421021850-project] 10.222.0.32 "GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe" status: 404 len: 111 microversion: 2.1 time: 0.073950 Jul 13 02:28:17.923104 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 99/192] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:17 2021] GET /compute/v2.1/servers/cdd6e2b3-3294-448d-b390-4340eb1cf4fe => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 02:28:18.263738 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-588b132e-a175-4061-af2e-ac2cd213986b tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21025e2c8aa9423dbd05da95f237b481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2c1d46685432e8656123be9d86664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:18.266527 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:18.266527 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:18.273387 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-588b132e-a175-4061-af2e-ac2cd213986b tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "GET /compute/v2.1/servers/97a3e7df-5271-4585-b962-e014adc2c87b" status: 200 len: 1318 microversion: 2.1 time: 0.464641 Jul 13 02:28:18.274331 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 94/193] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:17 2021] GET /compute/v2.1/servers/97a3e7df-5271-4585-b962-e014adc2c87b => generated 1318 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:18.325441 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-12890636-9d24-4e6a-8be5-3fec6700b04a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:18.326559 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-12890636-9d24-4e6a-8be5-3fec6700b04a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:18.332325 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-12890636-9d24-4e6a-8be5-3fec6700b04a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:18.332841 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-12890636-9d24-4e6a-8be5-3fec6700b04a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:18.333673 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-12890636-9d24-4e6a-8be5-3fec6700b04a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:18.334200 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-12890636-9d24-4e6a-8be5-3fec6700b04a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:18.336943 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:18.336943 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:18.358272 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-2d6607fb-3611-4d1a-ab67-6ec10af40fd8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:18.359363 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-2d6607fb-3611-4d1a-ab67-6ec10af40fd8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:18.365690 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2d6607fb-3611-4d1a-ab67-6ec10af40fd8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:18.367475 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2d6607fb-3611-4d1a-ab67-6ec10af40fd8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:18.368260 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2d6607fb-3611-4d1a-ab67-6ec10af40fd8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:18.368801 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2d6607fb-3611-4d1a-ab67-6ec10af40fd8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:18.371859 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:18.371859 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:21.591871 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-12890636-9d24-4e6a-8be5-3fec6700b04a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 200 len: 27341 microversion: 2.1 time: 3.269911 Jul 13 02:28:21.592462 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 100/194] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:28:18 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 27341 bytes in 3271 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:28:21.597287 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-0a46a56d-5538-4cc9-8b80-30e79fb22f4e tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:21.597984 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-0a46a56d-5538-4cc9-8b80-30e79fb22f4e tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d5e93419-e7dd-4cb3-9370-d46ec80bac7c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:21.604546 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-0a46a56d-5538-4cc9-8b80-30e79fb22f4e tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:21.604993 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-0a46a56d-5538-4cc9-8b80-30e79fb22f4e tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:21.605759 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-0a46a56d-5538-4cc9-8b80-30e79fb22f4e tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:21.606225 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-0a46a56d-5538-4cc9-8b80-30e79fb22f4e tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:21.609049 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:21.609049 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:21.629681 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-2d6607fb-3611-4d1a-ab67-6ec10af40fd8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 22162 microversion: 2.20 time: 3.275439 Jul 13 02:28:21.634374 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 95/195] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:28:18 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 22162 bytes in 3277 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 13 02:28:21.636272 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-25384201-ea31-4f04-bbb8-cb6123425471 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:21.636973 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-25384201-ea31-4f04-bbb8-cb6123425471 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:21.643779 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-25384201-ea31-4f04-bbb8-cb6123425471 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:21.644228 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-25384201-ea31-4f04-bbb8-cb6123425471 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:21.645005 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-25384201-ea31-4f04-bbb8-cb6123425471 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:21.645441 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-25384201-ea31-4f04-bbb8-cb6123425471 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:21.648662 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:21.648662 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:22.152428 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-0a46a56d-5538-4cc9-8b80-30e79fb22f4e tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:22.155033 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:22.155033 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:22.161822 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-0a46a56d-5538-4cc9-8b80-30e79fb22f4e tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/d5e93419-e7dd-4cb3-9370-d46ec80bac7c" status: 200 len: 1508 microversion: 2.1 time: 0.568235 Jul 13 02:28:22.174443 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 101/196] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:21 2021] GET /compute/v2.1/servers/d5e93419-e7dd-4cb3-9370-d46ec80bac7c => generated 1508 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:22.174443 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-1c59b038-d2e1-453c-9307-e26af9e5f734 req-10d1ec58-45fb-486c-bb77-9f8d6b5047d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97a3e7df-5271-4585-b962-e014adc2c87b", "tag": "806abd81-b203-4b96-891c-6f415ed06825"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:22.174443 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:28:22.174443 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:28:22.175839 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-1c59b038-d2e1-453c-9307-e26af9e5f734 req-10d1ec58-45fb-486c-bb77-9f8d6b5047d8 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:22.176278 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-1c59b038-d2e1-453c-9307-e26af9e5f734 req-10d1ec58-45fb-486c-bb77-9f8d6b5047d8 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:22.187944 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-1c59b038-d2e1-453c-9307-e26af9e5f734 req-10d1ec58-45fb-486c-bb77-9f8d6b5047d8 service nova] Creating event network-changed:806abd81-b203-4b96-891c-6f415ed06825 for instance 97a3e7df-5271-4585-b962-e014adc2c87b on hv-cinder-78102 Jul 13 02:28:22.192491 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-1c59b038-d2e1-453c-9307-e26af9e5f734 req-10d1ec58-45fb-486c-bb77-9f8d6b5047d8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028407 Jul 13 02:28:22.193074 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 102/197] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:28:22 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:28:22.198018 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-567a33b0-b486-4504-ac59-27a29f91a42c tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:22.198739 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-567a33b0-b486-4504-ac59-27a29f91a42c tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 97a3e7df-5271-4585-b962-e014adc2c87b] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:22.202982 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-25384201-ea31-4f04-bbb8-cb6123425471 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:22.205018 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-567a33b0-b486-4504-ac59-27a29f91a42c tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:22.205427 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-567a33b0-b486-4504-ac59-27a29f91a42c tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:22.205901 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:22.205901 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:22.206219 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-567a33b0-b486-4504-ac59-27a29f91a42c tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:22.206646 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-567a33b0-b486-4504-ac59-27a29f91a42c tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:22.209534 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:22.209534 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:22.213245 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-25384201-ea31-4f04-bbb8-cb6123425471 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1521 microversion: 2.1 time: 0.581735 Jul 13 02:28:22.213814 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 96/198] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:21 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1521 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:22.218232 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-537d33cb-7766-4b73-893d-c15ed331f777 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "534a15cb-a8d8-4336-bd42-50daaf280553"}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:22.219265 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-537d33cb-7766-4b73-893d-c15ed331f777 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d5e93419-e7dd-4cb3-9370-d46ec80bac7c] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:22.224665 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-537d33cb-7766-4b73-893d-c15ed331f777 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:22.225130 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-537d33cb-7766-4b73-893d-c15ed331f777 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:22.226753 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-537d33cb-7766-4b73-893d-c15ed331f777 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:22.227192 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-537d33cb-7766-4b73-893d-c15ed331f777 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:22.229967 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:22.229967 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:22.382672 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3019: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:22.382672 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context, Jul 13 02:28:22.390051 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.wsgi [None req-537d33cb-7766-4b73-893d-c15ed331f777 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] HTTP exception thrown: Invalid volume: volume 534a15cb-a8d8-4336-bd42-50daaf280553 is already attached to instances: d7423adc-bb73-46e2-8ddf-203316b7094a Jul 13 02:28:22.390669 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-537d33cb-7766-4b73-893d-c15ed331f777 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Returning 400 to user: Invalid volume: volume 534a15cb-a8d8-4336-bd42-50daaf280553 is already attached to instances: d7423adc-bb73-46e2-8ddf-203316b7094a {{(pid=107263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:28:22.391515 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-537d33cb-7766-4b73-893d-c15ed331f777 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "POST /compute/v2.1/servers/d5e93419-e7dd-4cb3-9370-d46ec80bac7c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.176763 Jul 13 02:28:22.392092 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 97/199] 10.222.0.32 () {60 vars in 1323 bytes} [Tue Jul 13 02:28:22 2021] POST /compute/v2.1/servers/d5e93419-e7dd-4cb3-9370-d46ec80bac7c/os-volume_attachments => generated 174 bytes in 178 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 13 02:28:22.397242 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-ad14319c-bd76-4644-8357-d2043fcde5d4 tempest-VolumesTestJSON-42649974 tempest-VolumesTestJSON-42649974-project] Calling method '.version_select at 0x7f4313914940>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:22.478145 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-ad14319c-bd76-4644-8357-d2043fcde5d4 tempest-VolumesTestJSON-42649974 tempest-VolumesTestJSON-42649974-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/d5dd60bb-35df-4b7d-a594-3f0e5888e1e1" status: 200 len: 351 microversion: 2.1 time: 0.084651 Jul 13 02:28:22.478884 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 98/200] 10.222.0.32 () {58 vars in 1245 bytes} [Tue Jul 13 02:28:22 2021] GET /compute/v2.1/os-volumes/d5dd60bb-35df-4b7d-a594-3f0e5888e1e1 => generated 351 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:28:22.483351 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-28cf82d5-b16e-4f76-b230-34e377688ed2 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:22.483839 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-28cf82d5-b16e-4f76-b230-34e377688ed2 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d7423adc-bb73-46e2-8ddf-203316b7094a] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:22.490845 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-28cf82d5-b16e-4f76-b230-34e377688ed2 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:22.492499 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-28cf82d5-b16e-4f76-b230-34e377688ed2 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:22.492768 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-28cf82d5-b16e-4f76-b230-34e377688ed2 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:22.493204 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-28cf82d5-b16e-4f76-b230-34e377688ed2 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:22.496528 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:22.496528 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:22.508935 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-567a33b0-b486-4504-ac59-27a29f91a42c tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21025e2c8aa9423dbd05da95f237b481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2c1d46685432e8656123be9d86664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:22.511609 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:22.511609 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:22.519293 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-567a33b0-b486-4504-ac59-27a29f91a42c tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "GET /compute/v2.1/servers/97a3e7df-5271-4585-b962-e014adc2c87b" status: 200 len: 1318 microversion: 2.1 time: 0.325084 Jul 13 02:28:22.519871 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 103/201] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:22 2021] GET /compute/v2.1/servers/97a3e7df-5271-4585-b962-e014adc2c87b => generated 1318 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:22.606152 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-e5eaf50b-7feb-4dfb-b917-346eafcbac74 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:22.608986 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-e5eaf50b-7feb-4dfb-b917-346eafcbac74 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:22.619323 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e5eaf50b-7feb-4dfb-b917-346eafcbac74 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:22.619888 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e5eaf50b-7feb-4dfb-b917-346eafcbac74 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:22.620971 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e5eaf50b-7feb-4dfb-b917-346eafcbac74 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:22.621408 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e5eaf50b-7feb-4dfb-b917-346eafcbac74 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:22.624600 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:22.624600 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:22.629243 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3031: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:22.629243 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context, Jul 13 02:28:22.637497 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.objects.instance [None req-28cf82d5-b16e-4f76-b230-34e377688ed2 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lazy-loading 'services' on Instance uuid d7423adc-bb73-46e2-8ddf-203316b7094a {{(pid=107263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 13 02:28:22.779116 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-28cf82d5-b16e-4f76-b230-34e377688ed2 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "DELETE /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a/os-volume_attachments/534a15cb-a8d8-4336-bd42-50daaf280553" status: 202 len: 0 microversion: 2.1 time: 0.299082 Jul 13 02:28:22.783124 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 99/202] 10.222.0.32 () {58 vars in 1416 bytes} [Tue Jul 13 02:28:22 2021] DELETE /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a/os-volume_attachments/534a15cb-a8d8-4336-bd42-50daaf280553 => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:28:22.785910 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-cfc8a390-8548-43e3-9447-637c8c95b7b7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:22.787022 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-cfc8a390-8548-43e3-9447-637c8c95b7b7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:22.794824 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-cfc8a390-8548-43e3-9447-637c8c95b7b7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:22.795051 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-cfc8a390-8548-43e3-9447-637c8c95b7b7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:22.796213 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-cfc8a390-8548-43e3-9447-637c8c95b7b7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:22.796661 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-cfc8a390-8548-43e3-9447-637c8c95b7b7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:22.805907 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-e5eaf50b-7feb-4dfb-b917-346eafcbac74 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 200 len: 27547 microversion: 2.1 time: 0.203438 Jul 13 02:28:22.806740 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 104/203] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:28:22 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 27547 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:28:22.810616 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:22.810616 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:22.983523 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-cfc8a390-8548-43e3-9447-637c8c95b7b7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 23225 microversion: 2.20 time: 0.202044 Jul 13 02:28:22.984224 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 100/204] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:28:22 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 23225 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:28:23.230840 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-953d7ff4-f9da-464d-97da-aacdefb47fc1 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:23.231571 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-953d7ff4-f9da-464d-97da-aacdefb47fc1 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:23.237961 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-953d7ff4-f9da-464d-97da-aacdefb47fc1 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:23.238441 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-953d7ff4-f9da-464d-97da-aacdefb47fc1 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:23.239207 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-953d7ff4-f9da-464d-97da-aacdefb47fc1 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:23.239649 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-953d7ff4-f9da-464d-97da-aacdefb47fc1 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:23.242468 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:23.242468 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:23.425841 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-953d7ff4-f9da-464d-97da-aacdefb47fc1 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:23.428947 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:23.428947 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:23.435795 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-953d7ff4-f9da-464d-97da-aacdefb47fc1 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1521 microversion: 2.1 time: 0.208995 Jul 13 02:28:23.436363 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 105/205] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:23 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:23.536685 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-a3f0b382-af08-48ec-9e14-c950e742730f tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:23.537393 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-a3f0b382-af08-48ec-9e14-c950e742730f tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 97a3e7df-5271-4585-b962-e014adc2c87b] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:23.544327 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a3f0b382-af08-48ec-9e14-c950e742730f tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:23.544773 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a3f0b382-af08-48ec-9e14-c950e742730f tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:23.545538 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a3f0b382-af08-48ec-9e14-c950e742730f tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:23.545973 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a3f0b382-af08-48ec-9e14-c950e742730f tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:23.549173 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:23.549173 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:23.746278 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-a3f0b382-af08-48ec-9e14-c950e742730f tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21025e2c8aa9423dbd05da95f237b481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2c1d46685432e8656123be9d86664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:23.749116 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:23.749116 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:23.755956 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-a3f0b382-af08-48ec-9e14-c950e742730f tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "GET /compute/v2.1/servers/97a3e7df-5271-4585-b962-e014adc2c87b" status: 200 len: 1318 microversion: 2.1 time: 0.223594 Jul 13 02:28:23.758217 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 101/206] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:23 2021] GET /compute/v2.1/servers/97a3e7df-5271-4585-b962-e014adc2c87b => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:23.822733 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-8080432d-63b9-4464-8926-8a6189d0fe46 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:23.822733 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-8080432d-63b9-4464-8926-8a6189d0fe46 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:23.825018 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8080432d-63b9-4464-8926-8a6189d0fe46 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:23.825652 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8080432d-63b9-4464-8926-8a6189d0fe46 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:23.826895 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8080432d-63b9-4464-8926-8a6189d0fe46 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:23.827522 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8080432d-63b9-4464-8926-8a6189d0fe46 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:23.828568 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-8c7d01bd-c99b-4926-8868-582ceed5472b tempest-VolumesTestJSON-42649974 tempest-VolumesTestJSON-42649974-project] Calling method '.version_select at 0x7f43138b0dc0>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:23.831080 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:23.831080 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:23.918294 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-8c7d01bd-c99b-4926-8868-582ceed5472b tempest-VolumesTestJSON-42649974 tempest-VolumesTestJSON-42649974-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/a554af02-d0ca-40b4-bc82-1079109afa46" status: 200 len: 351 microversion: 2.1 time: 0.093375 Jul 13 02:28:23.918883 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 102/207] 10.222.0.32 () {58 vars in 1245 bytes} [Tue Jul 13 02:28:23 2021] GET /compute/v2.1/os-volumes/a554af02-d0ca-40b4-bc82-1079109afa46 => generated 351 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 02:28:23.983821 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-8080432d-63b9-4464-8926-8a6189d0fe46 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 200 len: 27854 microversion: 2.1 time: 0.169816 Jul 13 02:28:23.984455 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 106/208] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:28:23 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 27854 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:28:23.995004 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-a321ba03-925e-4f0c-8df4-f28e9b529e76 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:23.995984 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-a321ba03-925e-4f0c-8df4-f28e9b529e76 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:24.001917 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a321ba03-925e-4f0c-8df4-f28e9b529e76 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:24.002436 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a321ba03-925e-4f0c-8df4-f28e9b529e76 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:24.003213 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a321ba03-925e-4f0c-8df4-f28e9b529e76 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:24.003630 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a321ba03-925e-4f0c-8df4-f28e9b529e76 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:24.006369 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:24.006369 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:24.174543 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-a321ba03-925e-4f0c-8df4-f28e9b529e76 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 23794 microversion: 2.20 time: 0.182897 Jul 13 02:28:24.175290 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 103/209] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:28:23 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 23794 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:28:24.452966 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-758061be-c430-4548-b17d-1d1821d3cc56 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:24.453654 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-758061be-c430-4548-b17d-1d1821d3cc56 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:24.460695 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-758061be-c430-4548-b17d-1d1821d3cc56 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:24.461130 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-758061be-c430-4548-b17d-1d1821d3cc56 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:24.461886 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-758061be-c430-4548-b17d-1d1821d3cc56 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:24.462377 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-758061be-c430-4548-b17d-1d1821d3cc56 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:24.465155 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:24.465155 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:24.632921 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-758061be-c430-4548-b17d-1d1821d3cc56 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:24.635495 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:24.635495 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:24.642603 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-758061be-c430-4548-b17d-1d1821d3cc56 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1521 microversion: 2.1 time: 0.193641 Jul 13 02:28:24.643177 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 107/210] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:24 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:24.773805 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-bbc2b545-c346-4b9f-bcb9-56c24965c197 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:24.774444 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-bbc2b545-c346-4b9f-bcb9-56c24965c197 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 97a3e7df-5271-4585-b962-e014adc2c87b] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:24.780855 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-bbc2b545-c346-4b9f-bcb9-56c24965c197 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:24.781307 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-bbc2b545-c346-4b9f-bcb9-56c24965c197 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:24.782097 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-bbc2b545-c346-4b9f-bcb9-56c24965c197 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:24.782536 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-bbc2b545-c346-4b9f-bcb9-56c24965c197 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:24.785375 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:24.785375 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:24.965387 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-bbc2b545-c346-4b9f-bcb9-56c24965c197 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21025e2c8aa9423dbd05da95f237b481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2c1d46685432e8656123be9d86664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:24.968135 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:24.968135 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:24.974993 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-bbc2b545-c346-4b9f-bcb9-56c24965c197 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "GET /compute/v2.1/servers/97a3e7df-5271-4585-b962-e014adc2c87b" status: 200 len: 1318 microversion: 2.1 time: 0.205284 Jul 13 02:28:24.976184 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 104/211] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:24 2021] GET /compute/v2.1/servers/97a3e7df-5271-4585-b962-e014adc2c87b => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:24.994728 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-c00220d5-a181-4120-b981-5b2547f00df7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:24.995660 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-c00220d5-a181-4120-b981-5b2547f00df7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:25.001986 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c00220d5-a181-4120-b981-5b2547f00df7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:25.002462 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c00220d5-a181-4120-b981-5b2547f00df7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:25.003230 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c00220d5-a181-4120-b981-5b2547f00df7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:25.003662 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c00220d5-a181-4120-b981-5b2547f00df7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:25.011197 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:25.011197 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:25.130294 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-dbb1234d-d66e-44ae-b27a-82607779661f tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-276993384", "imageRef": "1a3efd47-3618-4abd-b00b-a9fa9b90b4d4", "flavorRef": "452", "networks": [{"uuid": "bbf39b0f-a6a8-4156-9bab-028e4f2bf745"}]}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:25.183562 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.network.neutron [None req-dbb1234d-d66e-44ae-b27a-82607779661f tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] validate_networks() for [('bbf39b0f-a6a8-4156-9bab-028e4f2bf745', None, None, None)] {{(pid=107263) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Jul 13 02:28:25.194946 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-c00220d5-a181-4120-b981-5b2547f00df7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 200 len: 28212 microversion: 2.1 time: 0.203795 Jul 13 02:28:25.195788 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 108/212] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:28:24 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 28212 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:28:25.200737 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-c4eac1bf-2c84-48f3-b16e-f36b5aac260a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:25.201732 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-c4eac1bf-2c84-48f3-b16e-f36b5aac260a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:25.208116 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c4eac1bf-2c84-48f3-b16e-f36b5aac260a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:25.208564 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c4eac1bf-2c84-48f3-b16e-f36b5aac260a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:25.209329 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c4eac1bf-2c84-48f3-b16e-f36b5aac260a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:25.209762 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c4eac1bf-2c84-48f3-b16e-f36b5aac260a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:25.212495 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:25.212495 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:25.387184 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-c4eac1bf-2c84-48f3-b16e-f36b5aac260a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 24824 microversion: 2.20 time: 0.190074 Jul 13 02:28:25.391209 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 109/213] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:28:25 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 24824 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:28:25.392818 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-af977189-21cd-4346-b25b-51d2825d66ef tempest-VolumesTestJSON-42649974 tempest-VolumesTestJSON-42649974-project] Calling method '.version_select at 0x7f43126f09d0>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:25.447920 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-af977189-21cd-4346-b25b-51d2825d66ef tempest-VolumesTestJSON-42649974 tempest-VolumesTestJSON-42649974-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/162c8aa4-f160-482c-82b2-edf3d2784f65" status: 200 len: 351 microversion: 2.1 time: 0.058645 Jul 13 02:28:25.448478 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 110/214] 10.222.0.32 () {58 vars in 1245 bytes} [Tue Jul 13 02:28:25 2021] GET /compute/v2.1/os-volumes/162c8aa4-f160-482c-82b2-edf3d2784f65 => generated 351 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:28:25.458831 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-cd84fbff-2a1a-431b-a21e-4e56e005822e tempest-VolumesTestJSON-42649974 tempest-VolumesTestJSON-42649974-project] Calling method '.version_select at 0x7f4312799550>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:25.543617 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-cd84fbff-2a1a-431b-a21e-4e56e005822e tempest-VolumesTestJSON-42649974 tempest-VolumesTestJSON-42649974-project] 10.222.0.32 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.088080 Jul 13 02:28:25.544376 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 111/215] 10.222.0.32 () {58 vars in 1134 bytes} [Tue Jul 13 02:28:25 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:28:25.556466 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-92aeb7ea-f3fe-4c20-95a6-f4c0af6571f7 tempest-VolumesTestJSON-42649974 tempest-VolumesTestJSON-42649974-project] Calling method '.version_select at 0x7f4314c84940>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:25.572933 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-dbb1234d-d66e-44ae-b27a-82607779661f tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Flavor limits 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 02:28:25.573825 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-dbb1234d-d66e-44ae-b27a-82607779661f tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Image limits 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 02:28:25.573825 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-dbb1234d-d66e-44ae-b27a-82607779661f tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Flavor pref 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 02:28:25.574252 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-dbb1234d-d66e-44ae-b27a-82607779661f tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Image pref 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 02:28:25.574654 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-dbb1234d-d66e-44ae-b27a-82607779661f tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 02:28:25.580443 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2690: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:25.580443 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: user_quotas = model_query(context, models.ProjectUserQuota, Jul 13 02:28:25.586142 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-dbb1234d-d66e-44ae-b27a-82607779661f tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:25.586780 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-dbb1234d-d66e-44ae-b27a-82607779661f tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:25.587603 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-dbb1234d-d66e-44ae-b27a-82607779661f tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:25.588028 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-dbb1234d-d66e-44ae-b27a-82607779661f tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:25.592931 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/objects/instance.py:1537: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:25.592931 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: project_result = project_query.first() Jul 13 02:28:25.606430 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2708: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:25.606430 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: rows = model_query(context, models.Quota, read_deleted="no").\ Jul 13 02:28:25.611243 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.quota [None req-dbb1234d-d66e-44ae-b27a-82607779661f tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Getting quotas for project 6b3bcc4decdb4d42a7f3efd99887e102. Resources: {'ram', 'cores', 'instances'} {{(pid=107263) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 13 02:28:25.614242 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.quota [None req-dbb1234d-d66e-44ae-b27a-82607779661f tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Getting quotas for user f236dcca98c04f60aa827231eede0815 and project 6b3bcc4decdb4d42a7f3efd99887e102. Resources: {'ram', 'cores', 'instances'} {{(pid=107263) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 13 02:28:25.627034 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-dbb1234d-d66e-44ae-b27a-82607779661f tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Going to run 1 instances... {{(pid=107263) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 13 02:28:25.629365 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-dbb1234d-d66e-44ae-b27a-82607779661f tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: 55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a3efd47-3618-4abd-b00b-a9fa9b90b4d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 13 02:28:25.644734 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-92aeb7ea-f3fe-4c20-95a6-f4c0af6571f7 tempest-VolumesTestJSON-42649974 tempest-VolumesTestJSON-42649974-project] 10.222.0.32 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.091831 Jul 13 02:28:25.645308 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 112/216] 10.222.0.32 () {58 vars in 1149 bytes} [Tue Jul 13 02:28:25 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 02:28:25.658695 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-91dad946-702a-439e-a8e0-7c83986aa344 tempest-VolumesTestJSON-42649974 tempest-VolumesTestJSON-42649974-project] Calling method '.version_select at 0x7f431396c0d0>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:25.682618 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-dbb1234d-d66e-44ae-b27a-82607779661f tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.555917 Jul 13 02:28:25.683580 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 105/217] 10.222.0.32 () {60 vars in 1147 bytes} [Tue Jul 13 02:28:25 2021] POST /compute/v2.1/servers => generated 380 bytes in 557 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 13 02:28:25.688270 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-1b83d2b6-98c1-42b6-b648-9e890028ebc3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:25.688887 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-1b83d2b6-98c1-42b6-b648-9e890028ebc3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:25.695940 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-1b83d2b6-98c1-42b6-b648-9e890028ebc3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:25.696394 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-1b83d2b6-98c1-42b6-b648-9e890028ebc3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:25.697181 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-1b83d2b6-98c1-42b6-b648-9e890028ebc3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:25.697724 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-1b83d2b6-98c1-42b6-b648-9e890028ebc3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:25.701412 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:25.701412 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:25.755423 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-91dad946-702a-439e-a8e0-7c83986aa344 tempest-VolumesTestJSON-42649974 tempest-VolumesTestJSON-42649974-project] 10.222.0.32 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.100229 Jul 13 02:28:25.755997 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 113/218] 10.222.0.32 () {58 vars in 1134 bytes} [Tue Jul 13 02:28:25 2021] GET /compute/v2.1/os-volumes => generated 1036 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:28:25.763447 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-cf7bfcd8-0d28-4a53-b57b-3e01f8928d6e tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:25.764178 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-cf7bfcd8-0d28-4a53-b57b-3e01f8928d6e tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: 55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:25.846002 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-cf7bfcd8-0d28-4a53-b57b-3e01f8928d6e tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:25.848751 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:25.848751 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:25.856325 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-cf7bfcd8-0d28-4a53-b57b-3e01f8928d6e tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf" status: 200 len: 1217 microversion: 2.1 time: 0.098694 Jul 13 02:28:25.857094 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 114/219] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:25 2021] GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf => generated 1217 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:25.862566 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-5a2c2421-6d6e-4f36-9477-202299abc268 tempest-VolumesTestJSON-42649974 tempest-VolumesTestJSON-42649974-project] Calling method '.version_select at 0x7f43126aff70>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:25.942102 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-1b83d2b6-98c1-42b6-b648-9e890028ebc3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:25.945843 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:25.945843 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:25.959036 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-1b83d2b6-98c1-42b6-b648-9e890028ebc3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1521 microversion: 2.1 time: 0.273848 Jul 13 02:28:25.960475 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 106/220] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:25 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:25.994279 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-150aaf9f-2614-41e0-a573-ab3339c46fcc tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:25.995094 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-150aaf9f-2614-41e0-a573-ab3339c46fcc tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 97a3e7df-5271-4585-b962-e014adc2c87b] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:26.001648 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-150aaf9f-2614-41e0-a573-ab3339c46fcc tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:26.002544 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-150aaf9f-2614-41e0-a573-ab3339c46fcc tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:26.003440 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-150aaf9f-2614-41e0-a573-ab3339c46fcc tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:26.003944 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-150aaf9f-2614-41e0-a573-ab3339c46fcc tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:26.008689 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:26.008689 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:26.101060 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-5a2c2421-6d6e-4f36-9477-202299abc268 tempest-VolumesTestJSON-42649974 tempest-VolumesTestJSON-42649974-project] 10.222.0.32 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.242976 Jul 13 02:28:26.101890 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 115/221] 10.222.0.32 () {58 vars in 1167 bytes} [Tue Jul 13 02:28:25 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:28:26.113915 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-90a06d9e-ef07-4d6f-a923-3b49ba24df1e tempest-VolumesTestJSON-42649974 tempest-VolumesTestJSON-42649974-project] Calling method '.version_select at 0x7f43126f64c0>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:26.211793 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-150aaf9f-2614-41e0-a573-ab3339c46fcc tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21025e2c8aa9423dbd05da95f237b481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2c1d46685432e8656123be9d86664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:26.212298 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-90a06d9e-ef07-4d6f-a923-3b49ba24df1e tempest-VolumesTestJSON-42649974 tempest-VolumesTestJSON-42649974-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.102361 Jul 13 02:28:26.212922 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 116/222] 10.222.0.32 () {58 vars in 1170 bytes} [Tue Jul 13 02:28:26 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 02:28:26.215072 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:26.215072 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:26.218076 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-f413d3a2-ba01-4e54-a775-6e95f65e1a39 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:26.219198 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-f413d3a2-ba01-4e54-a775-6e95f65e1a39 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:26.226500 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-150aaf9f-2614-41e0-a573-ab3339c46fcc tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "GET /compute/v2.1/servers/97a3e7df-5271-4585-b962-e014adc2c87b" status: 200 len: 1318 microversion: 2.1 time: 0.236871 Jul 13 02:28:26.227331 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 107/223] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:25 2021] GET /compute/v2.1/servers/97a3e7df-5271-4585-b962-e014adc2c87b => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:28:26.231550 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f413d3a2-ba01-4e54-a775-6e95f65e1a39 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:26.231985 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f413d3a2-ba01-4e54-a775-6e95f65e1a39 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:26.232759 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f413d3a2-ba01-4e54-a775-6e95f65e1a39 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:26.233188 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f413d3a2-ba01-4e54-a775-6e95f65e1a39 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:26.236147 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:26.236147 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:26.240527 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-5f863c0f-f0e0-4919-81bf-661e060b4b5e tempest-VolumesTestJSON-42649974 tempest-VolumesTestJSON-42649974-project] Calling method '.version_select at 0x7f4312de1f70>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:26.350494 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-5f863c0f-f0e0-4919-81bf-661e060b4b5e tempest-VolumesTestJSON-42649974 tempest-VolumesTestJSON-42649974-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.113304 Jul 13 02:28:26.351284 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 108/224] 10.222.0.32 () {58 vars in 1155 bytes} [Tue Jul 13 02:28:26 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:26.365775 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-457d80b8-5f3f-453c-9417-2e0607218e6a tempest-VolumesTestJSON-42649974 tempest-VolumesTestJSON-42649974-project] Calling method '.version_select at 0x7f4312de1160>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:26.447306 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-f413d3a2-ba01-4e54-a775-6e95f65e1a39 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 200 len: 28212 microversion: 2.1 time: 0.232747 Jul 13 02:28:26.448631 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 117/225] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:28:26 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 28212 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:28:26.454884 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-457d80b8-5f3f-453c-9417-2e0607218e6a tempest-VolumesTestJSON-42649974 tempest-VolumesTestJSON-42649974-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.092526 Jul 13 02:28:26.455596 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 109/226] 10.222.0.32 () {58 vars in 1188 bytes} [Tue Jul 13 02:28:26 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:28:26.468524 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-74403eee-ec9f-465d-945e-d10dd238b4dc tempest-VolumesTestJSON-42649974 tempest-VolumesTestJSON-42649974-project] Calling method '.version_select at 0x7f43138ceaf0>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:26.472953 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-bd3bda41-5fe3-4f4e-906d-4ba8992d5827 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:26.473955 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-bd3bda41-5fe3-4f4e-906d-4ba8992d5827 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:26.488239 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-bd3bda41-5fe3-4f4e-906d-4ba8992d5827 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:26.488687 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-bd3bda41-5fe3-4f4e-906d-4ba8992d5827 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:26.489468 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-bd3bda41-5fe3-4f4e-906d-4ba8992d5827 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:26.489900 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-bd3bda41-5fe3-4f4e-906d-4ba8992d5827 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:26.494939 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:26.494939 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:26.578590 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-74403eee-ec9f-465d-945e-d10dd238b4dc tempest-VolumesTestJSON-42649974 tempest-VolumesTestJSON-42649974-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.115045 Jul 13 02:28:26.579163 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 110/227] 10.222.0.32 () {58 vars in 1155 bytes} [Tue Jul 13 02:28:26 2021] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:26.668198 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-bd3bda41-5fe3-4f4e-906d-4ba8992d5827 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 25846 microversion: 2.20 time: 0.217477 Jul 13 02:28:26.669087 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 118/228] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:28:26 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 25846 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:28:26.872961 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-e5161fc7-1b84-4df9-b7c1-d3546e69024e tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:26.873642 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-e5161fc7-1b84-4df9-b7c1-d3546e69024e tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: 55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:26.880153 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e5161fc7-1b84-4df9-b7c1-d3546e69024e tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:26.880683 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e5161fc7-1b84-4df9-b7c1-d3546e69024e tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:26.881365 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e5161fc7-1b84-4df9-b7c1-d3546e69024e tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:26.881824 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e5161fc7-1b84-4df9-b7c1-d3546e69024e tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:26.884891 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:26.884891 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:26.977863 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-90984f83-8800-441a-a14e-9d0b55ebddd3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:26.978652 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-90984f83-8800-441a-a14e-9d0b55ebddd3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:26.985528 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-90984f83-8800-441a-a14e-9d0b55ebddd3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:26.986321 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-90984f83-8800-441a-a14e-9d0b55ebddd3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:26.987229 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-90984f83-8800-441a-a14e-9d0b55ebddd3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:26.987660 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-90984f83-8800-441a-a14e-9d0b55ebddd3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:26.990822 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:26.990822 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:26.992902 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-e5161fc7-1b84-4df9-b7c1-d3546e69024e tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:26.996055 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:26.996055 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:27.004117 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-e5161fc7-1b84-4df9-b7c1-d3546e69024e tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf" status: 200 len: 1269 microversion: 2.1 time: 0.134942 Jul 13 02:28:27.010616 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 111/229] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:26 2021] GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf => generated 1269 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:27.187075 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-90984f83-8800-441a-a14e-9d0b55ebddd3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:27.189960 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:27.189960 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:27.199685 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-90984f83-8800-441a-a14e-9d0b55ebddd3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1521 microversion: 2.1 time: 0.224817 Jul 13 02:28:27.199685 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 119/230] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:26 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:28:27.242609 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-28ac6d48-b9d3-4711-8c25-9df4ab17e7e9 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:27.243218 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-28ac6d48-b9d3-4711-8c25-9df4ab17e7e9 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 97a3e7df-5271-4585-b962-e014adc2c87b] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:27.249188 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-28ac6d48-b9d3-4711-8c25-9df4ab17e7e9 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:27.249812 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-28ac6d48-b9d3-4711-8c25-9df4ab17e7e9 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:27.250788 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-28ac6d48-b9d3-4711-8c25-9df4ab17e7e9 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:27.251371 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-28ac6d48-b9d3-4711-8c25-9df4ab17e7e9 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:27.254618 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:27.254618 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:27.458579 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-335ff041-73a2-47b8-ae5d-385a1b5c928f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:27.459494 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-335ff041-73a2-47b8-ae5d-385a1b5c928f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:27.466218 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-335ff041-73a2-47b8-ae5d-385a1b5c928f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:27.466664 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-335ff041-73a2-47b8-ae5d-385a1b5c928f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:27.467433 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-335ff041-73a2-47b8-ae5d-385a1b5c928f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:27.467865 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-335ff041-73a2-47b8-ae5d-385a1b5c928f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:27.470865 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:27.470865 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:27.642516 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-28ac6d48-b9d3-4711-8c25-9df4ab17e7e9 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21025e2c8aa9423dbd05da95f237b481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2c1d46685432e8656123be9d86664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:27.645381 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:27.645381 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:27.655382 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-335ff041-73a2-47b8-ae5d-385a1b5c928f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 200 len: 28212 microversion: 2.1 time: 0.200280 Jul 13 02:28:27.656496 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 120/231] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:28:27 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 28212 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:28:27.665352 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-28ac6d48-b9d3-4711-8c25-9df4ab17e7e9 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "GET /compute/v2.1/servers/97a3e7df-5271-4585-b962-e014adc2c87b" status: 200 len: 1318 microversion: 2.1 time: 0.426497 Jul 13 02:28:27.666423 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 112/232] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:27 2021] GET /compute/v2.1/servers/97a3e7df-5271-4585-b962-e014adc2c87b => generated 1318 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:27.683876 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-c1b9cd31-868a-452d-a2c1-b6093277acbb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:27.684900 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-c1b9cd31-868a-452d-a2c1-b6093277acbb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:27.691835 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c1b9cd31-868a-452d-a2c1-b6093277acbb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:27.692734 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c1b9cd31-868a-452d-a2c1-b6093277acbb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:27.693732 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c1b9cd31-868a-452d-a2c1-b6093277acbb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:27.696872 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c1b9cd31-868a-452d-a2c1-b6093277acbb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:27.700739 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:27.700739 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:27.752843 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [req-210397e2-703d-4c0a-b780-9d4ccf11b293 req-5fe2b893-100f-4298-875d-dc9329268712 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97a3e7df-5271-4585-b962-e014adc2c87b", "name": "network-vif-plugged", "status": "completed", "tag": "806abd81-b203-4b96-891c-6f415ed06825"}]} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:27.764726 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:28:27.764726 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: warnings.warn(msg) Jul 13 02:28:27.782892 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-210397e2-703d-4c0a-b780-9d4ccf11b293 req-5fe2b893-100f-4298-875d-dc9329268712 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:27.783345 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-210397e2-703d-4c0a-b780-9d4ccf11b293 req-5fe2b893-100f-4298-875d-dc9329268712 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:27.818222 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.compute.server_external_events [req-210397e2-703d-4c0a-b780-9d4ccf11b293 req-5fe2b893-100f-4298-875d-dc9329268712 service nova] Creating event network-vif-plugged:806abd81-b203-4b96-891c-6f415ed06825 for instance 97a3e7df-5271-4585-b962-e014adc2c87b on hv-cinder-78102 Jul 13 02:28:27.824957 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [req-210397e2-703d-4c0a-b780-9d4ccf11b293 req-5fe2b893-100f-4298-875d-dc9329268712 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076278 Jul 13 02:28:27.826032 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 113/233] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:28:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:28:27.979602 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-c1b9cd31-868a-452d-a2c1-b6093277acbb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 26428 microversion: 2.20 time: 0.302063 Jul 13 02:28:27.980262 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 121/234] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:28:27 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 26428 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:28:28.023969 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-b153c6e4-6440-4aa9-8565-decc3fae25cd tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:28.026016 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-b153c6e4-6440-4aa9-8565-decc3fae25cd tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: 55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:28.043907 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b153c6e4-6440-4aa9-8565-decc3fae25cd tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:28.045972 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b153c6e4-6440-4aa9-8565-decc3fae25cd tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:28.047705 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b153c6e4-6440-4aa9-8565-decc3fae25cd tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:28.048216 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b153c6e4-6440-4aa9-8565-decc3fae25cd tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:28.057993 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:28.057993 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:28.206190 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-b153c6e4-6440-4aa9-8565-decc3fae25cd tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:28.209706 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:28.209706 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:28.219089 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-c5fa5ca7-050d-48ad-84d2-ff34e1979ea7 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:28.220404 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-c5fa5ca7-050d-48ad-84d2-ff34e1979ea7 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:28.225551 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-b153c6e4-6440-4aa9-8565-decc3fae25cd tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf" status: 200 len: 1275 microversion: 2.1 time: 0.206406 Jul 13 02:28:28.226531 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 114/235] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:28 2021] GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf => generated 1275 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:28:28.228847 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c5fa5ca7-050d-48ad-84d2-ff34e1979ea7 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:28.229546 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c5fa5ca7-050d-48ad-84d2-ff34e1979ea7 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:28.231094 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c5fa5ca7-050d-48ad-84d2-ff34e1979ea7 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:28.231767 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c5fa5ca7-050d-48ad-84d2-ff34e1979ea7 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:28.235678 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:28.235678 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:28.542839 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-c5fa5ca7-050d-48ad-84d2-ff34e1979ea7 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:28.545931 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:28.545931 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:28.553841 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-c5fa5ca7-050d-48ad-84d2-ff34e1979ea7 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1521 microversion: 2.1 time: 0.338614 Jul 13 02:28:28.554573 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 122/236] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:28 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1521 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:28:28.669699 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-fa018cc6-30db-46a8-9045-2ebe7f3bc679 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:28.670646 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-fa018cc6-30db-46a8-9045-2ebe7f3bc679 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:28.678058 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-fa018cc6-30db-46a8-9045-2ebe7f3bc679 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:28.678918 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-fa018cc6-30db-46a8-9045-2ebe7f3bc679 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:28.680427 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-fa018cc6-30db-46a8-9045-2ebe7f3bc679 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:28.681149 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-fa018cc6-30db-46a8-9045-2ebe7f3bc679 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:28.682987 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-441dbd68-c5da-462f-a9cd-99573bdb8bc0 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:28.683667 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-441dbd68-c5da-462f-a9cd-99573bdb8bc0 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 97a3e7df-5271-4585-b962-e014adc2c87b] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:28.685783 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:28.685783 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:28.691542 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-441dbd68-c5da-462f-a9cd-99573bdb8bc0 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:28.691542 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-441dbd68-c5da-462f-a9cd-99573bdb8bc0 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:28.691765 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-441dbd68-c5da-462f-a9cd-99573bdb8bc0 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:28.692092 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-441dbd68-c5da-462f-a9cd-99573bdb8bc0 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:28.695358 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:28.695358 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:28.915299 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-fa018cc6-30db-46a8-9045-2ebe7f3bc679 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 200 len: 28212 microversion: 2.1 time: 0.249152 Jul 13 02:28:28.916602 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 115/237] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:28:28 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 28212 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:28:28.919541 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-441dbd68-c5da-462f-a9cd-99573bdb8bc0 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21025e2c8aa9423dbd05da95f237b481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2c1d46685432e8656123be9d86664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:28.923776 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:28.923776 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:28.932235 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-441dbd68-c5da-462f-a9cd-99573bdb8bc0 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "GET /compute/v2.1/servers/97a3e7df-5271-4585-b962-e014adc2c87b" status: 200 len: 1318 microversion: 2.1 time: 0.253021 Jul 13 02:28:28.932802 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 123/238] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:28 2021] GET /compute/v2.1/servers/97a3e7df-5271-4585-b962-e014adc2c87b => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:28.994202 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-749db1a6-24ea-423e-8627-f1db30e60f38 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:28.998576 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-749db1a6-24ea-423e-8627-f1db30e60f38 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:29.007494 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-749db1a6-24ea-423e-8627-f1db30e60f38 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:29.011832 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-749db1a6-24ea-423e-8627-f1db30e60f38 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:29.013829 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-749db1a6-24ea-423e-8627-f1db30e60f38 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:29.016201 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-749db1a6-24ea-423e-8627-f1db30e60f38 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:29.020129 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:29.020129 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:29.220292 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-749db1a6-24ea-423e-8627-f1db30e60f38 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 26912 microversion: 2.20 time: 0.231739 Jul 13 02:28:29.224536 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 116/239] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:28:28 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 26912 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:28:29.243533 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-be674cd5-4672-47d2-8a36-6cc6ff0353dd tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:29.244283 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-be674cd5-4672-47d2-8a36-6cc6ff0353dd tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: 55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:29.250926 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-be674cd5-4672-47d2-8a36-6cc6ff0353dd tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:29.251371 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-be674cd5-4672-47d2-8a36-6cc6ff0353dd tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:29.252226 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-be674cd5-4672-47d2-8a36-6cc6ff0353dd tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:29.252609 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-be674cd5-4672-47d2-8a36-6cc6ff0353dd tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:29.255589 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:29.255589 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:29.563356 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-be674cd5-4672-47d2-8a36-6cc6ff0353dd tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:29.571256 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-96ef4a54-d72a-4161-9401-998d84c27ff3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:29.572063 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-96ef4a54-d72a-4161-9401-998d84c27ff3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:29.576872 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:29.576872 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:29.579374 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-96ef4a54-d72a-4161-9401-998d84c27ff3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:29.580344 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-96ef4a54-d72a-4161-9401-998d84c27ff3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:29.581231 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-96ef4a54-d72a-4161-9401-998d84c27ff3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:29.581769 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-96ef4a54-d72a-4161-9401-998d84c27ff3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:29.585601 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:29.585601 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:29.585857 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-be674cd5-4672-47d2-8a36-6cc6ff0353dd tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf" status: 200 len: 1317 microversion: 2.1 time: 0.346200 Jul 13 02:28:29.586607 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 124/240] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:29 2021] GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf => generated 1317 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:28:29.682329 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-7d1633a8-ef4a-4051-a3f7-e3eea4ae3d0f req-ae815cb5-9369-4f06-bc33-69fe52c2da4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf", "tag": "543eb3b5-2e4c-41c7-a86e-841db9532b16"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:29.687043 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:28:29.687043 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:28:29.696995 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-7d1633a8-ef4a-4051-a3f7-e3eea4ae3d0f req-ae815cb5-9369-4f06-bc33-69fe52c2da4b service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:29.697470 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-7d1633a8-ef4a-4051-a3f7-e3eea4ae3d0f req-ae815cb5-9369-4f06-bc33-69fe52c2da4b service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:29.708536 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-7d1633a8-ef4a-4051-a3f7-e3eea4ae3d0f req-ae815cb5-9369-4f06-bc33-69fe52c2da4b service nova] Creating event network-changed:543eb3b5-2e4c-41c7-a86e-841db9532b16 for instance 55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf on hv-cinder-78102 Jul 13 02:28:29.713353 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-7d1633a8-ef4a-4051-a3f7-e3eea4ae3d0f req-ae815cb5-9369-4f06-bc33-69fe52c2da4b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038318 Jul 13 02:28:29.714411 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 125/241] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:28:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 02:28:29.859032 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-96ef4a54-d72a-4161-9401-998d84c27ff3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:29.861710 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:29.861710 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:29.868673 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-96ef4a54-d72a-4161-9401-998d84c27ff3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1521 microversion: 2.1 time: 0.301635 Jul 13 02:28:29.869333 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 117/242] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:29 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:28:29.927969 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-011725a8-95bc-4d2c-8d88-25102bada457 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:29.929100 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-011725a8-95bc-4d2c-8d88-25102bada457 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:29.935124 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-011725a8-95bc-4d2c-8d88-25102bada457 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:29.935569 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-011725a8-95bc-4d2c-8d88-25102bada457 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:29.936341 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-011725a8-95bc-4d2c-8d88-25102bada457 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:29.936781 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-011725a8-95bc-4d2c-8d88-25102bada457 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:29.939511 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:29.939511 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:29.949000 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-49fcf576-0b46-41f6-b252-6ef49e436289 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:29.949896 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-49fcf576-0b46-41f6-b252-6ef49e436289 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 97a3e7df-5271-4585-b962-e014adc2c87b] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:29.956029 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-49fcf576-0b46-41f6-b252-6ef49e436289 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:29.956725 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-49fcf576-0b46-41f6-b252-6ef49e436289 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:29.957711 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-49fcf576-0b46-41f6-b252-6ef49e436289 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:29.958358 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-49fcf576-0b46-41f6-b252-6ef49e436289 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:29.962322 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:29.962322 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:30.168460 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-011725a8-95bc-4d2c-8d88-25102bada457 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 200 len: 28465 microversion: 2.1 time: 0.244097 Jul 13 02:28:30.169594 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 126/243] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:28:29 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 28465 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:28:30.233196 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-8fda5c17-d02f-4c3c-a469-8b0f7af94ba5 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:30.234230 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-8fda5c17-d02f-4c3c-a469-8b0f7af94ba5 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:30.255940 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-49fcf576-0b46-41f6-b252-6ef49e436289 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21025e2c8aa9423dbd05da95f237b481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2c1d46685432e8656123be9d86664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:30.257127 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8fda5c17-d02f-4c3c-a469-8b0f7af94ba5 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:30.257759 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8fda5c17-d02f-4c3c-a469-8b0f7af94ba5 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:30.258632 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8fda5c17-d02f-4c3c-a469-8b0f7af94ba5 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:30.259071 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8fda5c17-d02f-4c3c-a469-8b0f7af94ba5 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:30.261800 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:30.261800 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:30.262407 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:30.262407 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:30.270693 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-49fcf576-0b46-41f6-b252-6ef49e436289 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "GET /compute/v2.1/servers/97a3e7df-5271-4585-b962-e014adc2c87b" status: 200 len: 1318 microversion: 2.1 time: 0.325159 Jul 13 02:28:30.271518 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 118/244] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:29 2021] GET /compute/v2.1/servers/97a3e7df-5271-4585-b962-e014adc2c87b => generated 1318 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:28:30.477062 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-8fda5c17-d02f-4c3c-a469-8b0f7af94ba5 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 27272 microversion: 2.20 time: 0.248218 Jul 13 02:28:30.477709 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 127/245] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:28:30 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 27272 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:28:30.604947 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-7ae6c7ff-4bf7-421d-81b1-23e0334a4094 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:30.605885 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-7ae6c7ff-4bf7-421d-81b1-23e0334a4094 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: 55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:30.614933 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7ae6c7ff-4bf7-421d-81b1-23e0334a4094 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:30.616303 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7ae6c7ff-4bf7-421d-81b1-23e0334a4094 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:30.617956 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7ae6c7ff-4bf7-421d-81b1-23e0334a4094 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:30.619797 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7ae6c7ff-4bf7-421d-81b1-23e0334a4094 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:30.625275 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:30.625275 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:30.885234 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-00645e45-a611-4fc0-b49f-8f50e65328fc tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:30.885921 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-00645e45-a611-4fc0-b49f-8f50e65328fc tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:30.893081 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-00645e45-a611-4fc0-b49f-8f50e65328fc tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:30.893520 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-00645e45-a611-4fc0-b49f-8f50e65328fc tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:30.894324 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-00645e45-a611-4fc0-b49f-8f50e65328fc tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:30.894753 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-00645e45-a611-4fc0-b49f-8f50e65328fc tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:30.898849 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:30.898849 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:31.275008 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-7ae6c7ff-4bf7-421d-81b1-23e0334a4094 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:31.278894 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:31.278894 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:31.287238 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-7ae6c7ff-4bf7-421d-81b1-23e0334a4094 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf" status: 200 len: 1317 microversion: 2.1 time: 0.687783 Jul 13 02:28:31.288754 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 119/246] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:30 2021] GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf => generated 1317 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:31.293114 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-977f2a8b-f4e9-4c5c-b4ce-ad13fe88a999 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:31.294105 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-977f2a8b-f4e9-4c5c-b4ce-ad13fe88a999 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:31.307523 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-977f2a8b-f4e9-4c5c-b4ce-ad13fe88a999 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:31.308170 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-977f2a8b-f4e9-4c5c-b4ce-ad13fe88a999 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:31.309114 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-977f2a8b-f4e9-4c5c-b4ce-ad13fe88a999 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:31.309758 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-977f2a8b-f4e9-4c5c-b4ce-ad13fe88a999 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:31.313309 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:31.313309 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:31.428894 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-00645e45-a611-4fc0-b49f-8f50e65328fc tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:31.436510 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:31.436510 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:31.451864 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-00645e45-a611-4fc0-b49f-8f50e65328fc tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1521 microversion: 2.1 time: 0.569795 Jul 13 02:28:31.452711 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 128/247] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:30 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1521 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:31.468468 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-f307ad97-4da4-46ba-8405-8bc2e60084e3 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:31.469258 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-f307ad97-4da4-46ba-8405-8bc2e60084e3 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 97a3e7df-5271-4585-b962-e014adc2c87b] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:31.476088 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f307ad97-4da4-46ba-8405-8bc2e60084e3 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:31.476537 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f307ad97-4da4-46ba-8405-8bc2e60084e3 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:31.477778 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f307ad97-4da4-46ba-8405-8bc2e60084e3 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:31.478522 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f307ad97-4da4-46ba-8405-8bc2e60084e3 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:31.482198 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:31.482198 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:31.539160 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-977f2a8b-f4e9-4c5c-b4ce-ad13fe88a999 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 200 len: 28501 microversion: 2.1 time: 0.249160 Jul 13 02:28:31.539825 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 120/248] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:28:31 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 28501 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:28:31.544735 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-a57eae88-2edd-4a56-bc31-5a63a0d51b49 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:31.545786 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-a57eae88-2edd-4a56-bc31-5a63a0d51b49 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:31.561858 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a57eae88-2edd-4a56-bc31-5a63a0d51b49 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:31.562341 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a57eae88-2edd-4a56-bc31-5a63a0d51b49 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:31.563114 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a57eae88-2edd-4a56-bc31-5a63a0d51b49 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:31.563663 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a57eae88-2edd-4a56-bc31-5a63a0d51b49 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:31.566846 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:31.566846 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:31.767093 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-f307ad97-4da4-46ba-8405-8bc2e60084e3 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21025e2c8aa9423dbd05da95f237b481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2c1d46685432e8656123be9d86664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:31.769702 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:31.769702 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:31.774053 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-a57eae88-2edd-4a56-bc31-5a63a0d51b49 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 27570 microversion: 2.20 time: 0.232847 Jul 13 02:28:31.774852 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 121/249] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:28:31 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 27570 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:28:31.793010 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-f307ad97-4da4-46ba-8405-8bc2e60084e3 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "GET /compute/v2.1/servers/97a3e7df-5271-4585-b962-e014adc2c87b" status: 200 len: 1507 microversion: 2.1 time: 0.336295 Jul 13 02:28:31.793843 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 129/250] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:31 2021] GET /compute/v2.1/servers/97a3e7df-5271-4585-b962-e014adc2c87b => generated 1507 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:32.313886 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-d5eb1407-b148-4005-89f1-fa9de7bf446c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:32.314610 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-d5eb1407-b148-4005-89f1-fa9de7bf446c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: 55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:32.322497 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d5eb1407-b148-4005-89f1-fa9de7bf446c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:32.322947 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d5eb1407-b148-4005-89f1-fa9de7bf446c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:32.323766 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d5eb1407-b148-4005-89f1-fa9de7bf446c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:32.324189 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d5eb1407-b148-4005-89f1-fa9de7bf446c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:32.327739 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:32.327739 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:32.456773 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-270f1d44-a72d-49b2-85f1-d269e3dddd09 tempest-VolumesNegativeTest-1445290731 tempest-VolumesNegativeTest-1445290731-project] Action: 'create', calling method: .version_select at 0x7f431396cd30>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1539672279", "metadata": {"Type": "work"}}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:32.459413 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-270f1d44-a72d-49b2-85f1-d269e3dddd09 tempest-VolumesNegativeTest-1445290731 tempest-VolumesNegativeTest-1445290731-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=107262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:28:32.460881 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-270f1d44-a72d-49b2-85f1-d269e3dddd09 tempest-VolumesNegativeTest-1445290731 tempest-VolumesNegativeTest-1445290731-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.127048 Jul 13 02:28:32.461597 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 130/251] 10.222.0.32 () {60 vars in 1156 bytes} [Tue Jul 13 02:28:32 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 128 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 13 02:28:32.471326 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-fc30a26d-970c-478d-9345-80af0925a942 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:32.472063 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-fc30a26d-970c-478d-9345-80af0925a942 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:32.479719 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-fc30a26d-970c-478d-9345-80af0925a942 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:32.480166 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-fc30a26d-970c-478d-9345-80af0925a942 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:32.480939 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-fc30a26d-970c-478d-9345-80af0925a942 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:32.481537 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-fc30a26d-970c-478d-9345-80af0925a942 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:32.484919 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:32.484919 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:32.518175 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-d5eb1407-b148-4005-89f1-fa9de7bf446c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:32.521237 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:32.521237 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:32.528697 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-d5eb1407-b148-4005-89f1-fa9de7bf446c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf" status: 200 len: 1317 microversion: 2.1 time: 0.218714 Jul 13 02:28:32.529544 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 122/252] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:32 2021] GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:32.534310 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-7d8cf9ce-e665-4894-97d7-62d651b97758 tempest-VolumesNegativeTest-1445290731 tempest-VolumesNegativeTest-1445290731-project] Action: 'create', calling method: .version_select at 0x7f4312ea3d30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1985714329", "metadata": {"Type": "work"}}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:32.535932 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-7d8cf9ce-e665-4894-97d7-62d651b97758 tempest-VolumesNegativeTest-1445290731 tempest-VolumesNegativeTest-1445290731-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=107263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:28:32.536932 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-7d8cf9ce-e665-4894-97d7-62d651b97758 tempest-VolumesNegativeTest-1445290731 tempest-VolumesNegativeTest-1445290731-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006142 Jul 13 02:28:32.538188 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 123/253] 10.222.0.32 () {60 vars in 1156 bytes} [Tue Jul 13 02:28:32 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 13 02:28:32.551290 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-5972da0b-b2d1-4505-bbe2-8b00df7c65da tempest-VolumesNegativeTest-1445290731 tempest-VolumesNegativeTest-1445290731-project] Action: 'create', calling method: .version_select at 0x7f4313808940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-189144927", "metadata": {"Type": "work"}}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:32.552929 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-5972da0b-b2d1-4505-bbe2-8b00df7c65da tempest-VolumesNegativeTest-1445290731 tempest-VolumesNegativeTest-1445290731-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=107263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:28:32.553960 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-5972da0b-b2d1-4505-bbe2-8b00df7c65da tempest-VolumesNegativeTest-1445290731 tempest-VolumesNegativeTest-1445290731-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007210 Jul 13 02:28:32.554792 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 124/254] 10.222.0.32 () {60 vars in 1156 bytes} [Tue Jul 13 02:28:32 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 13 02:28:32.565758 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-08d4b2d1-f391-4e0f-88ba-9e257e91a6b2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:32.566679 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-08d4b2d1-f391-4e0f-88ba-9e257e91a6b2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:32.573755 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-08d4b2d1-f391-4e0f-88ba-9e257e91a6b2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:32.574241 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-08d4b2d1-f391-4e0f-88ba-9e257e91a6b2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:32.575025 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-08d4b2d1-f391-4e0f-88ba-9e257e91a6b2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:32.575463 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-08d4b2d1-f391-4e0f-88ba-9e257e91a6b2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:32.578431 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:32.578431 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:32.686731 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-fc30a26d-970c-478d-9345-80af0925a942 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:32.689400 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:32.689400 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:32.696573 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-fc30a26d-970c-478d-9345-80af0925a942 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1521 microversion: 2.1 time: 0.228719 Jul 13 02:28:32.697136 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 131/255] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:32 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:32.701365 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-7a4a8474-2a17-4245-adf6-83fdfd8b1c51 tempest-VolumesNegativeTest-1445290731 tempest-VolumesNegativeTest-1445290731-project] Calling method '.version_select at 0x7f43126f6a60>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:32.729555 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.wsgi [None req-7a4a8474-2a17-4245-adf6-83fdfd8b1c51 tempest-VolumesNegativeTest-1445290731 tempest-VolumesNegativeTest-1445290731-project] HTTP exception thrown: Volume tempest-invalid-362101356 could not be found. Jul 13 02:28:32.730171 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-7a4a8474-2a17-4245-adf6-83fdfd8b1c51 tempest-VolumesNegativeTest-1445290731 tempest-VolumesNegativeTest-1445290731-project] Returning 404 to user: Volume tempest-invalid-362101356 could not be found. {{(pid=107262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:28:32.730988 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-7a4a8474-2a17-4245-adf6-83fdfd8b1c51 tempest-VolumesNegativeTest-1445290731 tempest-VolumesNegativeTest-1445290731-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/tempest-invalid-362101356" status: 404 len: 98 microversion: 2.1 time: 0.032855 Jul 13 02:28:32.731685 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 132/256] 10.222.0.32 () {58 vars in 1215 bytes} [Tue Jul 13 02:28:32 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-362101356 => generated 98 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 13 02:28:32.740189 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-46713ca3-c69f-4a96-b761-fbf0ba8947ea tempest-VolumesNegativeTest-1445290731 tempest-VolumesNegativeTest-1445290731-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003506 Jul 13 02:28:32.741438 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 133/257] 10.222.0.32 () {58 vars in 1140 bytes} [Tue Jul 13 02:28:32 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 13 02:28:32.749961 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-a0f05c28-8706-4134-9ccb-55eb6494ca68 tempest-VolumesNegativeTest-1445290731 tempest-VolumesNegativeTest-1445290731-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003979 Jul 13 02:28:32.750495 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 134/258] 10.222.0.32 () {58 vars in 1137 bytes} [Tue Jul 13 02:28:32 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 13 02:28:32.759383 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-2976b65c-7e14-4866-9329-d559236b82c2 tempest-VolumesNegativeTest-1445290731 tempest-VolumesNegativeTest-1445290731-project] Calling method '.version_select at 0x7f4312799820>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:32.792154 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.wsgi [None req-2976b65c-7e14-4866-9329-d559236b82c2 tempest-VolumesNegativeTest-1445290731 tempest-VolumesNegativeTest-1445290731-project] HTTP exception thrown: Volume e2c4192a-8e66-458e-884e-9c026fc3f412 could not be found. Jul 13 02:28:32.792754 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-2976b65c-7e14-4866-9329-d559236b82c2 tempest-VolumesNegativeTest-1445290731 tempest-VolumesNegativeTest-1445290731-project] Returning 404 to user: Volume e2c4192a-8e66-458e-884e-9c026fc3f412 could not be found. {{(pid=107262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:28:32.793584 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-2976b65c-7e14-4866-9329-d559236b82c2 tempest-VolumesNegativeTest-1445290731 tempest-VolumesNegativeTest-1445290731-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/e2c4192a-8e66-458e-884e-9c026fc3f412" status: 404 len: 109 microversion: 2.1 time: 0.038465 Jul 13 02:28:32.794151 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 135/259] 10.222.0.32 () {58 vars in 1248 bytes} [Tue Jul 13 02:28:32 2021] DELETE /compute/v2.1/os-volumes/e2c4192a-8e66-458e-884e-9c026fc3f412 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 13 02:28:32.802794 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-3a7f0460-b207-4966-86d8-e340f7f7e8b4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:32.804149 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-3a7f0460-b207-4966-86d8-e340f7f7e8b4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:32.810175 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3a7f0460-b207-4966-86d8-e340f7f7e8b4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:32.810648 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3a7f0460-b207-4966-86d8-e340f7f7e8b4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:32.811415 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3a7f0460-b207-4966-86d8-e340f7f7e8b4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:32.811852 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3a7f0460-b207-4966-86d8-e340f7f7e8b4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:32.817910 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:32.817910 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:32.825031 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-08d4b2d1-f391-4e0f-88ba-9e257e91a6b2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 200 len: 28669 microversion: 2.1 time: 0.263912 Jul 13 02:28:32.825955 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 125/260] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:28:32 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 28669 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:28:32.834067 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-883319ce-7796-4a1e-b2f8-49c5777c0461 tempest-VolumesNegativeTest-1445290731 tempest-VolumesNegativeTest-1445290731-project] Calling method '.version_select at 0x7f4312e3a160>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:32.874553 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.wsgi [None req-883319ce-7796-4a1e-b2f8-49c5777c0461 tempest-VolumesNegativeTest-1445290731 tempest-VolumesNegativeTest-1445290731-project] HTTP exception thrown: Volume 7dcfeffa-87ae-4407-bdaf-a28235163719 could not be found. Jul 13 02:28:32.875966 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-883319ce-7796-4a1e-b2f8-49c5777c0461 tempest-VolumesNegativeTest-1445290731 tempest-VolumesNegativeTest-1445290731-project] Returning 404 to user: Volume 7dcfeffa-87ae-4407-bdaf-a28235163719 could not be found. {{(pid=107263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:28:32.877200 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-883319ce-7796-4a1e-b2f8-49c5777c0461 tempest-VolumesNegativeTest-1445290731 tempest-VolumesNegativeTest-1445290731-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/7dcfeffa-87ae-4407-bdaf-a28235163719" status: 404 len: 109 microversion: 2.1 time: 0.049938 Jul 13 02:28:32.877954 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 126/261] 10.222.0.32 () {58 vars in 1245 bytes} [Tue Jul 13 02:28:32 2021] GET /compute/v2.1/os-volumes/7dcfeffa-87ae-4407-bdaf-a28235163719 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 02:28:32.996233 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-3a7f0460-b207-4966-86d8-e340f7f7e8b4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 27771 microversion: 2.20 time: 0.196907 Jul 13 02:28:32.997393 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 136/262] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:28:32 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 27771 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:28:33.549876 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-a26e1624-245a-43b8-b66e-2efab6fb221a tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:33.551198 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-a26e1624-245a-43b8-b66e-2efab6fb221a tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: 55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:33.564012 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a26e1624-245a-43b8-b66e-2efab6fb221a tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:33.564643 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a26e1624-245a-43b8-b66e-2efab6fb221a tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:33.565615 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a26e1624-245a-43b8-b66e-2efab6fb221a tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:33.566136 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a26e1624-245a-43b8-b66e-2efab6fb221a tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:33.571171 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:33.571171 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:33.718962 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-26239411-edc3-4d00-9710-b97df694658d tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:33.723585 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-26239411-edc3-4d00-9710-b97df694658d tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:33.736798 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-26239411-edc3-4d00-9710-b97df694658d tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:33.737415 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-26239411-edc3-4d00-9710-b97df694658d tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:33.746001 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-26239411-edc3-4d00-9710-b97df694658d tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:33.746551 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-26239411-edc3-4d00-9710-b97df694658d tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:33.750161 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:33.750161 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:33.879095 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-a26e1624-245a-43b8-b66e-2efab6fb221a tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:33.882418 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:33.882418 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:33.891074 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-a26e1624-245a-43b8-b66e-2efab6fb221a tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf" status: 200 len: 1317 microversion: 2.1 time: 0.347907 Jul 13 02:28:33.900481 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 127/263] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:33 2021] GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf => generated 1317 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:33.905340 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-b32769c6-91a5-4e7a-87c5-f3dd37fccc81 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:33.906585 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-b32769c6-91a5-4e7a-87c5-f3dd37fccc81 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:33.914632 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b32769c6-91a5-4e7a-87c5-f3dd37fccc81 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:33.915076 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b32769c6-91a5-4e7a-87c5-f3dd37fccc81 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:33.916142 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b32769c6-91a5-4e7a-87c5-f3dd37fccc81 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:33.916979 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b32769c6-91a5-4e7a-87c5-f3dd37fccc81 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:33.923047 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:33.923047 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:34.010584 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-26239411-edc3-4d00-9710-b97df694658d tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:34.014013 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:34.014013 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:34.023148 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-26239411-edc3-4d00-9710-b97df694658d tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1521 microversion: 2.1 time: 0.310318 Jul 13 02:28:34.024078 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 137/264] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:33 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1521 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:34.029399 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-6e6c42e5-419c-45e6-bf94-ce1f4dab7f01 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:34.030413 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-6e6c42e5-419c-45e6-bf94-ce1f4dab7f01 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:34.040663 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-6e6c42e5-419c-45e6-bf94-ce1f4dab7f01 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:34.041112 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-6e6c42e5-419c-45e6-bf94-ce1f4dab7f01 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:34.041899 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-6e6c42e5-419c-45e6-bf94-ce1f4dab7f01 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:34.042356 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-6e6c42e5-419c-45e6-bf94-ce1f4dab7f01 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:34.045316 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:34.045316 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:34.089993 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-b32769c6-91a5-4e7a-87c5-f3dd37fccc81 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 200 len: 28669 microversion: 2.1 time: 0.193514 Jul 13 02:28:34.090791 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 128/265] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:28:33 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 28669 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:28:34.214819 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-6e6c42e5-419c-45e6-bf94-ce1f4dab7f01 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 28175 microversion: 2.20 time: 0.189119 Jul 13 02:28:34.215626 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 138/266] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:28:34 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 28175 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:28:34.908516 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-4fef73e0-0fb2-470a-a1dc-f7f604dcf740 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:34.909344 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-4fef73e0-0fb2-470a-a1dc-f7f604dcf740 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: 55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:34.916232 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4fef73e0-0fb2-470a-a1dc-f7f604dcf740 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:34.916684 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4fef73e0-0fb2-470a-a1dc-f7f604dcf740 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:34.917757 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4fef73e0-0fb2-470a-a1dc-f7f604dcf740 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:34.917883 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4fef73e0-0fb2-470a-a1dc-f7f604dcf740 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:34.921040 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:34.921040 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:35.043324 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-3e4ff286-88db-4796-9996-a4d6a99d98fa tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:35.044847 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-3e4ff286-88db-4796-9996-a4d6a99d98fa tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:35.053586 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3e4ff286-88db-4796-9996-a4d6a99d98fa tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:35.054082 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3e4ff286-88db-4796-9996-a4d6a99d98fa tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:35.055185 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3e4ff286-88db-4796-9996-a4d6a99d98fa tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:35.055621 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3e4ff286-88db-4796-9996-a4d6a99d98fa tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:35.059993 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:35.059993 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:35.118134 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-4fef73e0-0fb2-470a-a1dc-f7f604dcf740 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:35.120888 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:35.120888 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:35.127958 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-4fef73e0-0fb2-470a-a1dc-f7f604dcf740 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf" status: 200 len: 1317 microversion: 2.1 time: 0.223583 Jul 13 02:28:35.138624 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 129/267] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:34 2021] GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf => generated 1317 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:35.151299 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-d26c31c3-cfac-4834-937c-292d1448ce9a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:35.153169 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-d26c31c3-cfac-4834-937c-292d1448ce9a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:35.159748 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d26c31c3-cfac-4834-937c-292d1448ce9a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:35.160457 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d26c31c3-cfac-4834-937c-292d1448ce9a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:35.161623 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d26c31c3-cfac-4834-937c-292d1448ce9a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:35.162455 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d26c31c3-cfac-4834-937c-292d1448ce9a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:35.166678 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:35.166678 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:35.291200 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-3e4ff286-88db-4796-9996-a4d6a99d98fa tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:35.294408 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:35.294408 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:35.302521 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-3e4ff286-88db-4796-9996-a4d6a99d98fa tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1521 microversion: 2.1 time: 0.265351 Jul 13 02:28:35.303711 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 139/268] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:35 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:28:35.317498 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-be157da7-b3c4-4f8b-a6ac-8a04453eea86 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:35.318448 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-be157da7-b3c4-4f8b-a6ac-8a04453eea86 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:35.327740 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-be157da7-b3c4-4f8b-a6ac-8a04453eea86 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:35.328192 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-be157da7-b3c4-4f8b-a6ac-8a04453eea86 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:35.328970 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-be157da7-b3c4-4f8b-a6ac-8a04453eea86 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:35.329577 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-be157da7-b3c4-4f8b-a6ac-8a04453eea86 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:35.332511 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:35.332511 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:35.338481 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-d26c31c3-cfac-4834-937c-292d1448ce9a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 200 len: 28669 microversion: 2.1 time: 0.197472 Jul 13 02:28:35.339773 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 130/269] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:28:35 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 28669 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:28:35.486459 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-be157da7-b3c4-4f8b-a6ac-8a04453eea86 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 28175 microversion: 2.20 time: 0.172273 Jul 13 02:28:35.488032 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 140/270] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:28:35 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 28175 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:28:36.155178 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-ed095978-977f-4739-bfea-391a9580b73d tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:36.156838 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-ed095978-977f-4739-bfea-391a9580b73d tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: 55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:36.164135 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ed095978-977f-4739-bfea-391a9580b73d tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:36.164606 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ed095978-977f-4739-bfea-391a9580b73d tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:36.165511 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ed095978-977f-4739-bfea-391a9580b73d tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:36.165940 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ed095978-977f-4739-bfea-391a9580b73d tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:36.169228 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:36.169228 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:36.335146 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-5624d50b-7f5b-423d-bb6c-17ec5349af33 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:36.335146 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-5624d50b-7f5b-423d-bb6c-17ec5349af33 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:36.335146 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5624d50b-7f5b-423d-bb6c-17ec5349af33 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:36.335146 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5624d50b-7f5b-423d-bb6c-17ec5349af33 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:36.336009 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5624d50b-7f5b-423d-bb6c-17ec5349af33 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:36.336009 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5624d50b-7f5b-423d-bb6c-17ec5349af33 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:36.342753 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:36.342753 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:36.368043 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-ed095978-977f-4739-bfea-391a9580b73d tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:36.370633 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:36.370633 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:36.382128 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-ed095978-977f-4739-bfea-391a9580b73d tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf" status: 200 len: 1317 microversion: 2.1 time: 0.228174 Jul 13 02:28:36.382128 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 131/271] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:36 2021] GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf => generated 1317 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:36.390821 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-01519f5c-3647-435f-802c-62f1c23986f0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:36.391938 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-01519f5c-3647-435f-802c-62f1c23986f0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:36.398741 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-01519f5c-3647-435f-802c-62f1c23986f0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:36.399188 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-01519f5c-3647-435f-802c-62f1c23986f0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:36.400026 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-01519f5c-3647-435f-802c-62f1c23986f0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:36.400635 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-01519f5c-3647-435f-802c-62f1c23986f0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:36.403453 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:36.403453 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:36.545473 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-5624d50b-7f5b-423d-bb6c-17ec5349af33 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:36.548763 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:36.548763 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:36.557143 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-5624d50b-7f5b-423d-bb6c-17ec5349af33 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1521 microversion: 2.1 time: 0.240474 Jul 13 02:28:36.558262 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-01519f5c-3647-435f-802c-62f1c23986f0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 200 len: 28669 microversion: 2.1 time: 0.177909 Jul 13 02:28:36.558861 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 141/272] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:36 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:28:36.562881 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 132/273] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:28:36 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 28669 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:28:36.564617 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-c43f05f9-5587-4675-87ca-96606ac53e33 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:36.565628 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-c43f05f9-5587-4675-87ca-96606ac53e33 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:36.573093 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c43f05f9-5587-4675-87ca-96606ac53e33 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:36.573612 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c43f05f9-5587-4675-87ca-96606ac53e33 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:36.574499 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c43f05f9-5587-4675-87ca-96606ac53e33 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:36.574985 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c43f05f9-5587-4675-87ca-96606ac53e33 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:36.577978 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:36.577978 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:36.734154 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-c43f05f9-5587-4675-87ca-96606ac53e33 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 28175 microversion: 2.20 time: 0.172846 Jul 13 02:28:36.735701 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 142/274] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:28:36 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 28175 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:28:37.396572 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-8029a7bd-b463-4fb4-8fba-f2f5c9a5f15f tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:37.398752 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-8029a7bd-b463-4fb4-8fba-f2f5c9a5f15f tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: 55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:37.405562 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8029a7bd-b463-4fb4-8fba-f2f5c9a5f15f tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:37.406007 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8029a7bd-b463-4fb4-8fba-f2f5c9a5f15f tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:37.407777 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8029a7bd-b463-4fb4-8fba-f2f5c9a5f15f tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:37.408367 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8029a7bd-b463-4fb4-8fba-f2f5c9a5f15f tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:37.412095 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:37.412095 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:37.575352 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-cfdd4f0e-eea1-4fef-9c22-5d9d68d2cd26 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:37.576654 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-cfdd4f0e-eea1-4fef-9c22-5d9d68d2cd26 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:37.587905 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-cfdd4f0e-eea1-4fef-9c22-5d9d68d2cd26 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:37.588390 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-cfdd4f0e-eea1-4fef-9c22-5d9d68d2cd26 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:37.589218 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-cfdd4f0e-eea1-4fef-9c22-5d9d68d2cd26 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:37.589643 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-cfdd4f0e-eea1-4fef-9c22-5d9d68d2cd26 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:37.598560 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:37.598560 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:37.695923 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-8029a7bd-b463-4fb4-8fba-f2f5c9a5f15f tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:37.700656 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:37.700656 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:37.717958 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-8029a7bd-b463-4fb4-8fba-f2f5c9a5f15f tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf" status: 200 len: 1317 microversion: 2.1 time: 0.325634 Jul 13 02:28:37.719072 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 133/275] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:37 2021] GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf => generated 1317 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:37.724784 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-350a91e8-9e7a-4424-b768-f90d38430ccd tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:37.727592 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-350a91e8-9e7a-4424-b768-f90d38430ccd tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:37.736815 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-350a91e8-9e7a-4424-b768-f90d38430ccd tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:37.737343 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-350a91e8-9e7a-4424-b768-f90d38430ccd tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:37.738697 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-350a91e8-9e7a-4424-b768-f90d38430ccd tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:37.739210 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-350a91e8-9e7a-4424-b768-f90d38430ccd tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:37.744641 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:37.744641 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:37.792286 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-cfdd4f0e-eea1-4fef-9c22-5d9d68d2cd26 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 200 len: 28669 microversion: 2.1 time: 0.223071 Jul 13 02:28:37.796235 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 143/276] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:28:37 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 28669 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 13 02:28:37.801372 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-4e5cb453-d7be-4bbc-a3c0-8bc35debd58a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:37.804985 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-4e5cb453-d7be-4bbc-a3c0-8bc35debd58a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:37.814181 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-4e5cb453-d7be-4bbc-a3c0-8bc35debd58a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:37.814637 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-4e5cb453-d7be-4bbc-a3c0-8bc35debd58a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:37.815438 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-4e5cb453-d7be-4bbc-a3c0-8bc35debd58a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:37.815873 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-4e5cb453-d7be-4bbc-a3c0-8bc35debd58a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:37.819366 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:37.819366 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:38.023477 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-4e5cb453-d7be-4bbc-a3c0-8bc35debd58a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 28464 microversion: 2.20 time: 0.228489 Jul 13 02:28:38.024126 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 144/277] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:28:37 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 28464 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:28:38.025548 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-350a91e8-9e7a-4424-b768-f90d38430ccd tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:38.028897 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:38.028897 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:38.035800 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-63d60a21-39ee-4a95-b4a4-89d0219f6e5b req-f20f210f-bb27-4ba2-8172-79ba73ebd4e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf", "name": "network-vif-plugged", "status": "completed", "tag": "543eb3b5-2e4c-41c7-a86e-841db9532b16"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:38.035800 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:28:38.035800 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:28:38.037212 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-350a91e8-9e7a-4424-b768-f90d38430ccd tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1521 microversion: 2.1 time: 0.316788 Jul 13 02:28:38.037728 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 134/278] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:37 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:38.053313 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-63d60a21-39ee-4a95-b4a4-89d0219f6e5b req-f20f210f-bb27-4ba2-8172-79ba73ebd4e7 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:38.053779 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-63d60a21-39ee-4a95-b4a4-89d0219f6e5b req-f20f210f-bb27-4ba2-8172-79ba73ebd4e7 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:38.065440 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-63d60a21-39ee-4a95-b4a4-89d0219f6e5b req-f20f210f-bb27-4ba2-8172-79ba73ebd4e7 service nova] Creating event network-vif-plugged:543eb3b5-2e4c-41c7-a86e-841db9532b16 for instance 55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf on hv-cinder-78102 Jul 13 02:28:38.070913 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-63d60a21-39ee-4a95-b4a4-89d0219f6e5b req-f20f210f-bb27-4ba2-8172-79ba73ebd4e7 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045521 Jul 13 02:28:38.071733 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 145/279] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:28:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:28:38.735598 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-bbb1bc1b-ad68-41fd-bc33-0224831d09d2 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:38.742336 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-bbb1bc1b-ad68-41fd-bc33-0224831d09d2 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: 55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:38.748749 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-bbb1bc1b-ad68-41fd-bc33-0224831d09d2 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:38.749191 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-bbb1bc1b-ad68-41fd-bc33-0224831d09d2 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:38.749972 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-bbb1bc1b-ad68-41fd-bc33-0224831d09d2 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:38.750710 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-bbb1bc1b-ad68-41fd-bc33-0224831d09d2 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:38.753971 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:38.753971 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:38.804850 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-c8e8a04a-10b0-4295-a9ee-2d6a8c0daca7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:38.806020 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-c8e8a04a-10b0-4295-a9ee-2d6a8c0daca7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:38.813717 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c8e8a04a-10b0-4295-a9ee-2d6a8c0daca7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:38.814323 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c8e8a04a-10b0-4295-a9ee-2d6a8c0daca7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:38.815364 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c8e8a04a-10b0-4295-a9ee-2d6a8c0daca7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:38.816020 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c8e8a04a-10b0-4295-a9ee-2d6a8c0daca7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:38.819889 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:38.819889 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:38.954112 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-bbb1bc1b-ad68-41fd-bc33-0224831d09d2 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:38.957169 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:38.957169 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:38.965896 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-bbb1bc1b-ad68-41fd-bc33-0224831d09d2 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf" status: 200 len: 1317 microversion: 2.1 time: 0.234218 Jul 13 02:28:38.966921 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 135/280] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:38 2021] GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:39.035554 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-e163d35a-1748-4e85-9df7-38b05c73a7e4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:39.036527 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-e163d35a-1748-4e85-9df7-38b05c73a7e4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:39.043289 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e163d35a-1748-4e85-9df7-38b05c73a7e4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:39.043740 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e163d35a-1748-4e85-9df7-38b05c73a7e4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:39.044512 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e163d35a-1748-4e85-9df7-38b05c73a7e4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:39.044942 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e163d35a-1748-4e85-9df7-38b05c73a7e4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:39.049631 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:39.049631 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:39.056863 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-c8e8a04a-10b0-4295-a9ee-2d6a8c0daca7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 200 len: 29630 microversion: 2.1 time: 0.256969 Jul 13 02:28:39.061124 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 146/281] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:28:38 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 29630 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:28:39.069014 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-463c212d-294e-4595-9ecc-53cee71f0503 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:39.069904 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-463c212d-294e-4595-9ecc-53cee71f0503 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:39.078179 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-463c212d-294e-4595-9ecc-53cee71f0503 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:39.078812 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-463c212d-294e-4595-9ecc-53cee71f0503 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:39.080372 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-463c212d-294e-4595-9ecc-53cee71f0503 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:39.080891 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-463c212d-294e-4595-9ecc-53cee71f0503 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:39.084839 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:39.084839 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:39.244137 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-e163d35a-1748-4e85-9df7-38b05c73a7e4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 28464 microversion: 2.20 time: 0.211814 Jul 13 02:28:39.245211 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 136/282] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:28:39 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 28464 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 13 02:28:39.337775 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-463c212d-294e-4595-9ecc-53cee71f0503 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:39.341205 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:39.341205 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:39.348909 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-463c212d-294e-4595-9ecc-53cee71f0503 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1521 microversion: 2.1 time: 0.286018 Jul 13 02:28:39.351385 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 147/283] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:39 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:39.984648 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-0c926beb-790a-48ae-af3e-c26b900e79f9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:39.985277 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-0c926beb-790a-48ae-af3e-c26b900e79f9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: 55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:39.992457 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0c926beb-790a-48ae-af3e-c26b900e79f9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:39.992898 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0c926beb-790a-48ae-af3e-c26b900e79f9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:39.993650 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0c926beb-790a-48ae-af3e-c26b900e79f9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:39.994107 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0c926beb-790a-48ae-af3e-c26b900e79f9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:39.996925 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:39.996925 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:40.068865 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-f3ba53ca-7d73-4a75-8aeb-01684f55ab9e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:40.069835 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-f3ba53ca-7d73-4a75-8aeb-01684f55ab9e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:40.076091 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f3ba53ca-7d73-4a75-8aeb-01684f55ab9e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:40.076530 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f3ba53ca-7d73-4a75-8aeb-01684f55ab9e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:40.077302 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f3ba53ca-7d73-4a75-8aeb-01684f55ab9e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:40.077725 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f3ba53ca-7d73-4a75-8aeb-01684f55ab9e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:40.080413 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:40.080413 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:40.173614 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-0c926beb-790a-48ae-af3e-c26b900e79f9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:40.176518 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:40.176518 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:40.184077 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-0c926beb-790a-48ae-af3e-c26b900e79f9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf" status: 200 len: 1317 microversion: 2.1 time: 0.203550 Jul 13 02:28:40.184650 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 137/284] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:39 2021] GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf => generated 1317 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:40.255705 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-af991804-10bf-4f52-a9f6-00de2557797c tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:40.256597 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-af991804-10bf-4f52-a9f6-00de2557797c tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:40.262530 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-af991804-10bf-4f52-a9f6-00de2557797c tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:40.263228 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-af991804-10bf-4f52-a9f6-00de2557797c tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:40.263985 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-af991804-10bf-4f52-a9f6-00de2557797c tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:40.264418 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-af991804-10bf-4f52-a9f6-00de2557797c tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:40.267120 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:40.267120 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:40.296011 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-f3ba53ca-7d73-4a75-8aeb-01684f55ab9e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 200 len: 30569 microversion: 2.1 time: 0.230866 Jul 13 02:28:40.296664 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 148/285] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:28:40 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 30569 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:28:40.367659 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-8213286a-3530-42a4-a099-3adc97171a48 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:40.368356 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-8213286a-3530-42a4-a099-3adc97171a48 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:40.374834 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8213286a-3530-42a4-a099-3adc97171a48 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:40.375282 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8213286a-3530-42a4-a099-3adc97171a48 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:40.376046 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8213286a-3530-42a4-a099-3adc97171a48 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:40.376478 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8213286a-3530-42a4-a099-3adc97171a48 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:40.379309 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:40.379309 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:40.454418 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-af991804-10bf-4f52-a9f6-00de2557797c tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 28631 microversion: 2.20 time: 0.202265 Jul 13 02:28:40.457375 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 138/286] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:28:40 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 28631 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 13 02:28:40.562446 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-8213286a-3530-42a4-a099-3adc97171a48 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:40.565520 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:40.565520 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:40.582826 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-8213286a-3530-42a4-a099-3adc97171a48 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1521 microversion: 2.1 time: 0.219112 Jul 13 02:28:40.583401 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 149/287] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:40 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:28:41.201413 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-b103e91f-af1c-4035-9623-ef84b98c709c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:41.202141 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-b103e91f-af1c-4035-9623-ef84b98c709c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: 55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:41.208952 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b103e91f-af1c-4035-9623-ef84b98c709c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:41.209983 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b103e91f-af1c-4035-9623-ef84b98c709c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:41.210790 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b103e91f-af1c-4035-9623-ef84b98c709c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:41.211248 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b103e91f-af1c-4035-9623-ef84b98c709c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:41.214581 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:41.214581 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:41.307787 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-74216fcc-7964-4448-b31f-5ecac5b512a7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:41.309405 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-74216fcc-7964-4448-b31f-5ecac5b512a7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:41.317546 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-74216fcc-7964-4448-b31f-5ecac5b512a7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:41.318208 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-74216fcc-7964-4448-b31f-5ecac5b512a7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:41.319337 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-74216fcc-7964-4448-b31f-5ecac5b512a7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:41.320007 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-74216fcc-7964-4448-b31f-5ecac5b512a7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:41.323351 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:41.323351 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:41.431479 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-b103e91f-af1c-4035-9623-ef84b98c709c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:41.434426 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:41.434426 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:41.442575 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-b103e91f-af1c-4035-9623-ef84b98c709c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf" status: 200 len: 1508 microversion: 2.1 time: 0.245179 Jul 13 02:28:41.443150 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 139/288] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:41 2021] GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf => generated 1508 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:41.470272 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-5d7f785f-7818-4ec1-ac84-7028eb45d045 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:41.472480 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-5d7f785f-7818-4ec1-ac84-7028eb45d045 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:41.482069 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5d7f785f-7818-4ec1-ac84-7028eb45d045 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:41.483098 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5d7f785f-7818-4ec1-ac84-7028eb45d045 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:41.484179 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5d7f785f-7818-4ec1-ac84-7028eb45d045 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:41.484622 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5d7f785f-7818-4ec1-ac84-7028eb45d045 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:41.487699 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:41.487699 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:41.526541 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-74216fcc-7964-4448-b31f-5ecac5b512a7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 200 len: 31990 microversion: 2.1 time: 0.222069 Jul 13 02:28:41.533145 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 150/289] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:28:41 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 31990 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 13 02:28:41.602163 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-1de01317-d0a8-49f7-9a83-41a8b0731e53 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:41.602460 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-1de01317-d0a8-49f7-9a83-41a8b0731e53 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:41.609737 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1de01317-d0a8-49f7-9a83-41a8b0731e53 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:41.610244 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1de01317-d0a8-49f7-9a83-41a8b0731e53 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:41.611021 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1de01317-d0a8-49f7-9a83-41a8b0731e53 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:41.611419 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1de01317-d0a8-49f7-9a83-41a8b0731e53 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:41.614561 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:41.614561 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:41.658813 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-5d7f785f-7818-4ec1-ac84-7028eb45d045 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 28631 microversion: 2.20 time: 0.195325 Jul 13 02:28:41.660101 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 140/290] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:28:41 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 28631 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:28:41.825484 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-1de01317-d0a8-49f7-9a83-41a8b0731e53 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:41.828175 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:41.828175 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:41.835759 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-1de01317-d0a8-49f7-9a83-41a8b0731e53 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1501 microversion: 2.1 time: 0.238971 Jul 13 02:28:41.836323 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 151/291] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:41 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1501 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:28:41.853394 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-4a223efc-0267-4a70-948b-2f36330ff882 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:41.854199 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-4a223efc-0267-4a70-948b-2f36330ff882 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:41.861034 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4a223efc-0267-4a70-948b-2f36330ff882 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:41.861537 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4a223efc-0267-4a70-948b-2f36330ff882 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:41.862397 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4a223efc-0267-4a70-948b-2f36330ff882 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:41.862833 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4a223efc-0267-4a70-948b-2f36330ff882 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:41.865902 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:41.865902 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:42.042853 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-4a223efc-0267-4a70-948b-2f36330ff882 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:42.045499 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:42.045499 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:42.052506 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-4a223efc-0267-4a70-948b-2f36330ff882 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1514 microversion: 2.1 time: 0.203748 Jul 13 02:28:42.053088 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 141/292] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:41 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1514 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:42.539873 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-a3998a5b-141a-4846-aa21-4a3fb814a5ea tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:42.540786 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-a3998a5b-141a-4846-aa21-4a3fb814a5ea tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:42.547105 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a3998a5b-141a-4846-aa21-4a3fb814a5ea tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:42.547551 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a3998a5b-141a-4846-aa21-4a3fb814a5ea tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:42.548320 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a3998a5b-141a-4846-aa21-4a3fb814a5ea tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:42.548758 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a3998a5b-141a-4846-aa21-4a3fb814a5ea tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:42.551445 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:42.551445 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:42.671735 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-655eb738-ffca-4e1a-ae0b-eaa2739f065e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:42.672830 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-655eb738-ffca-4e1a-ae0b-eaa2739f065e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:42.679576 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-655eb738-ffca-4e1a-ae0b-eaa2739f065e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:42.680101 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-655eb738-ffca-4e1a-ae0b-eaa2739f065e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:42.680875 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-655eb738-ffca-4e1a-ae0b-eaa2739f065e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:42.681347 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-655eb738-ffca-4e1a-ae0b-eaa2739f065e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:42.684076 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:42.684076 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:42.710426 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-a3998a5b-141a-4846-aa21-4a3fb814a5ea tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 200 len: 32541 microversion: 2.1 time: 0.174160 Jul 13 02:28:42.711080 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 152/293] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:28:42 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 32541 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:28:42.863511 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-655eb738-ffca-4e1a-ae0b-eaa2739f065e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 28631 microversion: 2.20 time: 0.195371 Jul 13 02:28:42.869355 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 142/294] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:28:42 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 28631 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:28:42.905769 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-d7d75f40-9a8b-476b-b2b4-da39bc4bc9c8 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "39a998ea-dea8-49cb-b55b-9dc8f177a3c1"}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:42.907172 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-d7d75f40-9a8b-476b-b2b4-da39bc4bc9c8 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: 55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:42.916589 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d7d75f40-9a8b-476b-b2b4-da39bc4bc9c8 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:42.917044 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d7d75f40-9a8b-476b-b2b4-da39bc4bc9c8 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:42.917823 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d7d75f40-9a8b-476b-b2b4-da39bc4bc9c8 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:42.918286 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d7d75f40-9a8b-476b-b2b4-da39bc4bc9c8 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:42.921252 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:42.921252 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:43.043596 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3019: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:43.043596 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context, Jul 13 02:28:43.133610 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2940: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:43.133610 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: query.update(values) Jul 13 02:28:43.136375 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2941: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:43.136375 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return query.first() Jul 13 02:28:43.229882 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2940: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:43.229882 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: query.update(values) Jul 13 02:28:43.232586 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2941: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:43.232586 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return query.first() Jul 13 02:28:43.251858 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-d7d75f40-9a8b-476b-b2b4-da39bc4bc9c8 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "POST /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.350446 Jul 13 02:28:43.252448 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 153/295] 10.222.0.32 () {60 vars in 1323 bytes} [Tue Jul 13 02:28:42 2021] POST /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf/os-volume_attachments => generated 194 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:28:43.422381 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-364fc64a-958b-4841-9437-51daa1b25294 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:43.423403 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-364fc64a-958b-4841-9437-51daa1b25294 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:43.429880 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-364fc64a-958b-4841-9437-51daa1b25294 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:43.430384 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-364fc64a-958b-4841-9437-51daa1b25294 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:43.431157 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-364fc64a-958b-4841-9437-51daa1b25294 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:43.431602 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-364fc64a-958b-4841-9437-51daa1b25294 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:43.434286 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:43.434286 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:43.492901 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.objects.instance [None req-364fc64a-958b-4841-9437-51daa1b25294 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lazy-loading 'flavor' on Instance uuid 163ad440-5d5c-420d-ab44-52f27c5e22dc {{(pid=107263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 13 02:28:43.505781 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3008: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:43.505781 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).\ Jul 13 02:28:43.518502 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2557: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:43.518502 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: rows_updated = model_query(context, models.InstanceExtra).\ Jul 13 02:28:43.526479 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:43.526479 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:43.585141 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/update_match.py:472: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:43.585141 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = query.session.execute(update_stmt) Jul 13 02:28:43.607373 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-364fc64a-958b-4841-9437-51daa1b25294 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "POST /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc/action" status: 200 len: 32 microversion: 2.1 time: 0.189093 Jul 13 02:28:43.608092 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 143/296] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:28:43 2021] POST /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc/action => generated 32 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 13 02:28:43.618441 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-5d4bd1c0-35c4-4d22-ab28-46c1b6173c95 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:43.619131 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-5d4bd1c0-35c4-4d22-ab28-46c1b6173c95 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:43.625109 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5d4bd1c0-35c4-4d22-ab28-46c1b6173c95 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:43.625549 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5d4bd1c0-35c4-4d22-ab28-46c1b6173c95 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:43.626394 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5d4bd1c0-35c4-4d22-ab28-46c1b6173c95 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:43.626943 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5d4bd1c0-35c4-4d22-ab28-46c1b6173c95 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:43.632095 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:43.632095 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:43.722905 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-c4702cea-854d-4d3d-add0-8d82c4cc3d64 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:43.723826 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-c4702cea-854d-4d3d-add0-8d82c4cc3d64 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:43.730556 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c4702cea-854d-4d3d-add0-8d82c4cc3d64 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:43.731006 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c4702cea-854d-4d3d-add0-8d82c4cc3d64 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:43.731775 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c4702cea-854d-4d3d-add0-8d82c4cc3d64 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:43.732211 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c4702cea-854d-4d3d-add0-8d82c4cc3d64 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:43.735032 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:43.735032 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:43.807926 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-5d4bd1c0-35c4-4d22-ab28-46c1b6173c95 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:43.810525 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:43.810525 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:43.817309 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-5d4bd1c0-35c4-4d22-ab28-46c1b6173c95 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1520 microversion: 2.1 time: 0.202940 Jul 13 02:28:43.817865 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 154/297] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:43 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:28:43.876216 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-6423d441-fb8b-41ca-8643-be4bda5dd0ca tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:43.877172 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-6423d441-fb8b-41ca-8643-be4bda5dd0ca tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:43.884409 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-6423d441-fb8b-41ca-8643-be4bda5dd0ca tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:43.884848 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-6423d441-fb8b-41ca-8643-be4bda5dd0ca tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:43.886421 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-6423d441-fb8b-41ca-8643-be4bda5dd0ca tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:43.887203 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-6423d441-fb8b-41ca-8643-be4bda5dd0ca tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:43.890268 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:43.890268 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:46.630995 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-c4702cea-854d-4d3d-add0-8d82c4cc3d64 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 200 len: 34149 microversion: 2.1 time: 2.911851 Jul 13 02:28:46.632196 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 144/298] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:28:43 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 34149 bytes in 2914 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 13 02:28:46.637422 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-2f2263bb-7663-4eca-9d1d-8336571f3576 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:46.638399 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-2f2263bb-7663-4eca-9d1d-8336571f3576 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:46.644662 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2f2263bb-7663-4eca-9d1d-8336571f3576 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:46.645102 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2f2263bb-7663-4eca-9d1d-8336571f3576 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:46.645852 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2f2263bb-7663-4eca-9d1d-8336571f3576 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:46.646318 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2f2263bb-7663-4eca-9d1d-8336571f3576 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:46.649201 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:46.649201 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:46.655266 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-6423d441-fb8b-41ca-8643-be4bda5dd0ca tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 28631 microversion: 2.20 time: 2.782438 Jul 13 02:28:46.656025 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 155/299] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:28:43 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 28631 bytes in 2784 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 13 02:28:46.904094 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-2f2263bb-7663-4eca-9d1d-8336571f3576 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:46.906662 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:46.906662 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:46.914109 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-2f2263bb-7663-4eca-9d1d-8336571f3576 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1520 microversion: 2.1 time: 0.280383 Jul 13 02:28:46.914672 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 145/300] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:46 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1520 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:47.644754 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-a16dcfe7-87ee-4130-8bb5-9df05a93878d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:47.645754 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-a16dcfe7-87ee-4130-8bb5-9df05a93878d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:47.653864 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a16dcfe7-87ee-4130-8bb5-9df05a93878d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:47.654557 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a16dcfe7-87ee-4130-8bb5-9df05a93878d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:47.655672 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a16dcfe7-87ee-4130-8bb5-9df05a93878d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:47.656247 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a16dcfe7-87ee-4130-8bb5-9df05a93878d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:47.659535 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:47.659535 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:47.672644 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-758fd150-0e35-49ad-b86a-726cbecd8085 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:47.674222 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-758fd150-0e35-49ad-b86a-726cbecd8085 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:47.684280 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-758fd150-0e35-49ad-b86a-726cbecd8085 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:47.685032 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-758fd150-0e35-49ad-b86a-726cbecd8085 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:47.686337 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-758fd150-0e35-49ad-b86a-726cbecd8085 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:47.687073 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-758fd150-0e35-49ad-b86a-726cbecd8085 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:47.692105 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:47.692105 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:47.852523 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-a16dcfe7-87ee-4130-8bb5-9df05a93878d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 200 len: 35367 microversion: 2.1 time: 0.211986 Jul 13 02:28:47.856731 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 156/301] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:28:47 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 35367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:28:47.897056 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-758fd150-0e35-49ad-b86a-726cbecd8085 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 28631 microversion: 2.20 time: 0.230841 Jul 13 02:28:47.897798 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 146/302] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:28:47 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 28631 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 13 02:28:47.931576 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-5db84ee6-993a-41b9-9125-8c3ff1481662 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:47.932261 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-5db84ee6-993a-41b9-9125-8c3ff1481662 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:47.938922 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5db84ee6-993a-41b9-9125-8c3ff1481662 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:47.939371 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5db84ee6-993a-41b9-9125-8c3ff1481662 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:47.940132 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5db84ee6-993a-41b9-9125-8c3ff1481662 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:47.940627 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5db84ee6-993a-41b9-9125-8c3ff1481662 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:47.944265 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:47.944265 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:48.114987 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-5db84ee6-993a-41b9-9125-8c3ff1481662 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:48.118076 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:48.118076 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:48.124877 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-5db84ee6-993a-41b9-9125-8c3ff1481662 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1520 microversion: 2.1 time: 0.198314 Jul 13 02:28:48.125435 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 157/303] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:47 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:48.864478 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-50704d15-f139-4656-a8c4-584e8623109a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:48.865790 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-50704d15-f139-4656-a8c4-584e8623109a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:48.872076 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-50704d15-f139-4656-a8c4-584e8623109a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:48.872515 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-50704d15-f139-4656-a8c4-584e8623109a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:48.873332 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-50704d15-f139-4656-a8c4-584e8623109a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:48.873756 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-50704d15-f139-4656-a8c4-584e8623109a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:48.876449 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:48.876449 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:48.908919 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-94d721b0-f80c-4ab0-8196-7d13dc12ce36 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:48.909962 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-94d721b0-f80c-4ab0-8196-7d13dc12ce36 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:48.916815 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-94d721b0-f80c-4ab0-8196-7d13dc12ce36 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:48.917122 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-94d721b0-f80c-4ab0-8196-7d13dc12ce36 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:48.917935 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-94d721b0-f80c-4ab0-8196-7d13dc12ce36 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:48.918393 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-94d721b0-f80c-4ab0-8196-7d13dc12ce36 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:48.921268 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:48.921268 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:49.086830 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-50704d15-f139-4656-a8c4-584e8623109a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 200 len: 36942 microversion: 2.1 time: 0.226297 Jul 13 02:28:49.090996 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 147/304] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:28:48 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 36942 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:28:49.110061 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-94d721b0-f80c-4ab0-8196-7d13dc12ce36 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 28631 microversion: 2.20 time: 0.204672 Jul 13 02:28:49.111817 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 158/305] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:28:48 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 28631 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:28:49.142855 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-48c3f5a3-0dec-4e60-bfde-abf16bf427dc tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:49.143544 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-48c3f5a3-0dec-4e60-bfde-abf16bf427dc tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:49.150447 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-48c3f5a3-0dec-4e60-bfde-abf16bf427dc tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:49.150905 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-48c3f5a3-0dec-4e60-bfde-abf16bf427dc tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:49.151664 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-48c3f5a3-0dec-4e60-bfde-abf16bf427dc tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:49.152094 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-48c3f5a3-0dec-4e60-bfde-abf16bf427dc tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:49.154961 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:49.154961 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:49.372921 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-48c3f5a3-0dec-4e60-bfde-abf16bf427dc tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:49.375574 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:49.375574 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:49.383401 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-48c3f5a3-0dec-4e60-bfde-abf16bf427dc tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1520 microversion: 2.1 time: 0.244431 Jul 13 02:28:49.383971 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 148/306] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:49 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1520 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:50.099258 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-22e47688-7ae2-49d3-b1b0-79cfedbbb80c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:50.100272 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-22e47688-7ae2-49d3-b1b0-79cfedbbb80c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:50.106737 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-22e47688-7ae2-49d3-b1b0-79cfedbbb80c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:50.107180 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-22e47688-7ae2-49d3-b1b0-79cfedbbb80c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:50.107947 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-22e47688-7ae2-49d3-b1b0-79cfedbbb80c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:50.108375 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-22e47688-7ae2-49d3-b1b0-79cfedbbb80c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:50.111202 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:50.111202 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:50.123595 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-399d5acb-7a8b-47d7-9248-f915951ae569 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:50.125288 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-399d5acb-7a8b-47d7-9248-f915951ae569 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:50.137553 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-399d5acb-7a8b-47d7-9248-f915951ae569 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:50.138229 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-399d5acb-7a8b-47d7-9248-f915951ae569 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:50.139073 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-399d5acb-7a8b-47d7-9248-f915951ae569 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:50.139571 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-399d5acb-7a8b-47d7-9248-f915951ae569 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:50.142631 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:50.142631 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:50.310428 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-22e47688-7ae2-49d3-b1b0-79cfedbbb80c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 200 len: 37700 microversion: 2.1 time: 0.214966 Jul 13 02:28:50.313154 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 159/307] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:28:50 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 37700 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:28:50.340807 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-399d5acb-7a8b-47d7-9248-f915951ae569 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 28631 microversion: 2.20 time: 0.221600 Jul 13 02:28:50.341629 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 149/308] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:28:50 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 28631 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 13 02:28:50.401466 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-ad5b4d74-1a31-45c7-aba0-c2e28c2f6a1e tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:50.402206 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-ad5b4d74-1a31-45c7-aba0-c2e28c2f6a1e tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:50.408570 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ad5b4d74-1a31-45c7-aba0-c2e28c2f6a1e tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:50.409030 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ad5b4d74-1a31-45c7-aba0-c2e28c2f6a1e tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:50.409792 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ad5b4d74-1a31-45c7-aba0-c2e28c2f6a1e tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:50.410364 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ad5b4d74-1a31-45c7-aba0-c2e28c2f6a1e tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:50.413392 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:50.413392 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:50.652317 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-ad5b4d74-1a31-45c7-aba0-c2e28c2f6a1e tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:50.655007 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:50.655007 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:50.663291 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-ad5b4d74-1a31-45c7-aba0-c2e28c2f6a1e tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1520 microversion: 2.1 time: 0.266180 Jul 13 02:28:50.663977 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 160/309] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:50 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1520 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:51.325200 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-1736fd4c-7e84-4b5b-b8dd-8b365f15ce3b tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:51.327217 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-1736fd4c-7e84-4b5b-b8dd-8b365f15ce3b tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:51.334999 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-1736fd4c-7e84-4b5b-b8dd-8b365f15ce3b tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:51.335474 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-1736fd4c-7e84-4b5b-b8dd-8b365f15ce3b tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:51.336385 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-1736fd4c-7e84-4b5b-b8dd-8b365f15ce3b tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:51.342521 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-1736fd4c-7e84-4b5b-b8dd-8b365f15ce3b tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:51.347677 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:51.347677 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:51.352841 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-79979569-46b0-4039-bb13-d4de85290062 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:51.353776 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-79979569-46b0-4039-bb13-d4de85290062 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:51.361708 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-79979569-46b0-4039-bb13-d4de85290062 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:51.362624 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-79979569-46b0-4039-bb13-d4de85290062 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:51.363684 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-79979569-46b0-4039-bb13-d4de85290062 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:51.364327 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-79979569-46b0-4039-bb13-d4de85290062 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:51.368331 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:51.368331 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:51.550210 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-1736fd4c-7e84-4b5b-b8dd-8b365f15ce3b tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 200 len: 38123 microversion: 2.1 time: 0.228656 Jul 13 02:28:51.551021 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 150/310] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:28:51 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 38123 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:28:51.573129 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-79979569-46b0-4039-bb13-d4de85290062 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 28631 microversion: 2.20 time: 0.224111 Jul 13 02:28:51.574199 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 161/311] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:28:51 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 28631 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 13 02:28:51.681432 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-ce291e92-2ac7-4a7b-9570-30246d6c711f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:51.682248 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-ce291e92-2ac7-4a7b-9570-30246d6c711f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:51.689435 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ce291e92-2ac7-4a7b-9570-30246d6c711f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:51.690062 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ce291e92-2ac7-4a7b-9570-30246d6c711f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:51.691067 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ce291e92-2ac7-4a7b-9570-30246d6c711f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:51.691506 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ce291e92-2ac7-4a7b-9570-30246d6c711f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:51.695609 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:51.695609 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:51.955215 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-ce291e92-2ac7-4a7b-9570-30246d6c711f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:51.958050 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:51.958050 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:51.966880 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-ce291e92-2ac7-4a7b-9570-30246d6c711f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1520 microversion: 2.1 time: 0.290565 Jul 13 02:28:51.967449 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 151/312] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:51 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1520 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:52.562683 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-289c62bb-81fc-4353-af6e-847b325ea0cc tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:52.563677 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-289c62bb-81fc-4353-af6e-847b325ea0cc tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:52.571060 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-289c62bb-81fc-4353-af6e-847b325ea0cc tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:52.571789 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-289c62bb-81fc-4353-af6e-847b325ea0cc tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:52.572687 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-289c62bb-81fc-4353-af6e-847b325ea0cc tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:52.573355 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-289c62bb-81fc-4353-af6e-847b325ea0cc tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:52.578391 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:52.578391 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:52.585978 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-44e775f6-e803-4f36-88e7-2738a573952b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:52.587181 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-44e775f6-e803-4f36-88e7-2738a573952b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:52.592843 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-44e775f6-e803-4f36-88e7-2738a573952b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:52.593286 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-44e775f6-e803-4f36-88e7-2738a573952b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:52.594100 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-44e775f6-e803-4f36-88e7-2738a573952b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:52.594529 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-44e775f6-e803-4f36-88e7-2738a573952b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:52.597225 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:52.597225 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:52.751945 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-289c62bb-81fc-4353-af6e-847b325ea0cc tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 200 len: 38123 microversion: 2.1 time: 0.193059 Jul 13 02:28:52.752601 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 162/313] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:28:52 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 38123 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:28:52.791918 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-44e775f6-e803-4f36-88e7-2738a573952b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 28998 microversion: 2.20 time: 0.210170 Jul 13 02:28:52.792698 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 152/314] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:28:52 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 28998 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:28:52.984499 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-c72241fd-e688-483f-8578-8e5b5acd6450 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:52.985223 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-c72241fd-e688-483f-8578-8e5b5acd6450 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:52.993583 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c72241fd-e688-483f-8578-8e5b5acd6450 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:52.994016 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c72241fd-e688-483f-8578-8e5b5acd6450 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:52.994816 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c72241fd-e688-483f-8578-8e5b5acd6450 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:52.995243 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c72241fd-e688-483f-8578-8e5b5acd6450 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:52.998145 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:52.998145 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:53.181312 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-c72241fd-e688-483f-8578-8e5b5acd6450 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:53.183956 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:53.183956 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:53.195143 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-c72241fd-e688-483f-8578-8e5b5acd6450 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1520 microversion: 2.1 time: 0.214694 Jul 13 02:28:53.195815 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 163/315] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:52 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1520 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:53.249687 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-153dcc8b-442c-4e13-b0e6-30eec6aaa222 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1118812668", "imageRef": "1a3efd47-3618-4abd-b00b-a9fa9b90b4d4", "flavorRef": "452"}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:53.308279 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.network.neutron [None req-153dcc8b-442c-4e13-b0e6-30eec6aaa222 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] validate_networks() for None {{(pid=107263) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Jul 13 02:28:53.585813 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-153dcc8b-442c-4e13-b0e6-30eec6aaa222 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Flavor limits 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 02:28:53.586268 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-153dcc8b-442c-4e13-b0e6-30eec6aaa222 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Image limits 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 02:28:53.586843 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-153dcc8b-442c-4e13-b0e6-30eec6aaa222 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Flavor pref 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 02:28:53.587143 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-153dcc8b-442c-4e13-b0e6-30eec6aaa222 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Image pref 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 02:28:53.587557 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-153dcc8b-442c-4e13-b0e6-30eec6aaa222 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 02:28:53.593323 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2690: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:53.593323 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: user_quotas = model_query(context, models.ProjectUserQuota, Jul 13 02:28:53.597072 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-153dcc8b-442c-4e13-b0e6-30eec6aaa222 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:53.597521 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-153dcc8b-442c-4e13-b0e6-30eec6aaa222 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:53.598353 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-153dcc8b-442c-4e13-b0e6-30eec6aaa222 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:53.598793 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-153dcc8b-442c-4e13-b0e6-30eec6aaa222 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:53.604160 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/objects/instance.py:1537: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:53.604160 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: project_result = project_query.first() Jul 13 02:28:53.616438 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2708: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:53.616438 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: rows = model_query(context, models.Quota, read_deleted="no").\ Jul 13 02:28:53.620139 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.quota [None req-153dcc8b-442c-4e13-b0e6-30eec6aaa222 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Getting quotas for project 0cde6389460449d8b56f7b5098c7b590. Resources: {'ram', 'cores', 'instances'} {{(pid=107263) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 13 02:28:53.625296 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.quota [None req-153dcc8b-442c-4e13-b0e6-30eec6aaa222 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Getting quotas for user 177c67d168e5457eb50a960f2bff0838 and project 0cde6389460449d8b56f7b5098c7b590. Resources: {'ram', 'cores', 'instances'} {{(pid=107263) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 13 02:28:53.638655 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-153dcc8b-442c-4e13-b0e6-30eec6aaa222 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Going to run 1 instances... {{(pid=107263) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 13 02:28:53.641076 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-153dcc8b-442c-4e13-b0e6-30eec6aaa222 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] [instance: d685507b-3451-47d7-a263-a2ef87d8f116] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a3efd47-3618-4abd-b00b-a9fa9b90b4d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 13 02:28:53.683900 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-153dcc8b-442c-4e13-b0e6-30eec6aaa222 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.438727 Jul 13 02:28:53.684543 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 153/316] 10.222.0.32 () {60 vars in 1147 bytes} [Tue Jul 13 02:28:53 2021] POST /compute/v2.1/servers => generated 380 bytes in 440 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 02:28:53.694937 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-cb83c168-9606-4763-8491-416537b63cf4 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:53.696204 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-cb83c168-9606-4763-8491-416537b63cf4 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] [instance: d685507b-3451-47d7-a263-a2ef87d8f116] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:53.766713 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-6d59c399-4f06-45b8-bcc2-8259da1f0c9a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:53.767896 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-cb83c168-9606-4763-8491-416537b63cf4 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177c67d168e5457eb50a960f2bff0838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cde6389460449d8b56f7b5098c7b590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:53.768273 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-6d59c399-4f06-45b8-bcc2-8259da1f0c9a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:53.776192 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:53.776192 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:53.778262 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6d59c399-4f06-45b8-bcc2-8259da1f0c9a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:53.779642 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6d59c399-4f06-45b8-bcc2-8259da1f0c9a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:53.780899 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6d59c399-4f06-45b8-bcc2-8259da1f0c9a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:53.781662 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6d59c399-4f06-45b8-bcc2-8259da1f0c9a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:53.782786 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-cb83c168-9606-4763-8491-416537b63cf4 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] 10.222.0.32 "GET /compute/v2.1/servers/d685507b-3451-47d7-a263-a2ef87d8f116" status: 200 len: 1215 microversion: 2.1 time: 0.092105 Jul 13 02:28:53.783369 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 164/317] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:53 2021] GET /compute/v2.1/servers/d685507b-3451-47d7-a263-a2ef87d8f116 => generated 1215 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:53.785558 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:53.785558 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:53.805283 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-f7ab5350-46db-4673-9506-f314280ff6a9 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:53.806294 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-f7ab5350-46db-4673-9506-f314280ff6a9 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:53.812241 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f7ab5350-46db-4673-9506-f314280ff6a9 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:53.812861 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f7ab5350-46db-4673-9506-f314280ff6a9 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:53.813635 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f7ab5350-46db-4673-9506-f314280ff6a9 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:53.814092 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f7ab5350-46db-4673-9506-f314280ff6a9 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:53.816844 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:53.816844 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:53.995806 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-6d59c399-4f06-45b8-bcc2-8259da1f0c9a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 200 len: 38123 microversion: 2.1 time: 0.234864 Jul 13 02:28:53.996926 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 154/318] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:28:53 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 38123 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 13 02:28:54.069315 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-f7ab5350-46db-4673-9506-f314280ff6a9 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 30039 microversion: 2.20 time: 0.268379 Jul 13 02:28:54.070166 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 165/319] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:28:53 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 30039 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 13 02:28:54.213781 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-8a61c43d-492d-49cc-a936-25826a643440 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:54.214509 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-8a61c43d-492d-49cc-a936-25826a643440 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:54.220863 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8a61c43d-492d-49cc-a936-25826a643440 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:54.221307 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8a61c43d-492d-49cc-a936-25826a643440 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:54.222314 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8a61c43d-492d-49cc-a936-25826a643440 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:54.222747 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8a61c43d-492d-49cc-a936-25826a643440 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:54.227066 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:54.227066 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:54.410374 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-8a61c43d-492d-49cc-a936-25826a643440 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:54.414463 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:54.414463 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:54.421530 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-8a61c43d-492d-49cc-a936-25826a643440 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1520 microversion: 2.1 time: 0.212521 Jul 13 02:28:54.422119 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 155/320] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:54 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1520 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:54.800726 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-629a6327-e4f9-49c4-af68-53556c76f7d8 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:54.801598 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-629a6327-e4f9-49c4-af68-53556c76f7d8 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] [instance: d685507b-3451-47d7-a263-a2ef87d8f116] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:54.810751 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-629a6327-e4f9-49c4-af68-53556c76f7d8 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:54.811206 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-629a6327-e4f9-49c4-af68-53556c76f7d8 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:54.812070 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-629a6327-e4f9-49c4-af68-53556c76f7d8 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:54.812466 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-629a6327-e4f9-49c4-af68-53556c76f7d8 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:54.816434 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:54.816434 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:54.937891 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-629a6327-e4f9-49c4-af68-53556c76f7d8 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177c67d168e5457eb50a960f2bff0838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cde6389460449d8b56f7b5098c7b590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:54.941776 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:54.941776 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:54.950092 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-629a6327-e4f9-49c4-af68-53556c76f7d8 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] 10.222.0.32 "GET /compute/v2.1/servers/d685507b-3451-47d7-a263-a2ef87d8f116" status: 200 len: 1267 microversion: 2.1 time: 0.153551 Jul 13 02:28:54.951118 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 166/321] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:54 2021] GET /compute/v2.1/servers/d685507b-3451-47d7-a263-a2ef87d8f116 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:55.009913 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-ae465d14-7ba2-4630-832c-c6d5db497bed tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:55.011874 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-ae465d14-7ba2-4630-832c-c6d5db497bed tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:55.026156 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ae465d14-7ba2-4630-832c-c6d5db497bed tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:55.026708 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ae465d14-7ba2-4630-832c-c6d5db497bed tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:55.027909 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ae465d14-7ba2-4630-832c-c6d5db497bed tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:55.028578 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ae465d14-7ba2-4630-832c-c6d5db497bed tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:55.031920 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:55.031920 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:55.084017 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-87d59945-67c0-4a02-a05a-771519f93982 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:55.085727 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-87d59945-67c0-4a02-a05a-771519f93982 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:55.092479 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-87d59945-67c0-4a02-a05a-771519f93982 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:55.093097 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-87d59945-67c0-4a02-a05a-771519f93982 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:55.093854 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-87d59945-67c0-4a02-a05a-771519f93982 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:55.100143 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-87d59945-67c0-4a02-a05a-771519f93982 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:55.105324 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:55.105324 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:55.200353 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-ae465d14-7ba2-4630-832c-c6d5db497bed tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 200 len: 38126 microversion: 2.1 time: 0.195527 Jul 13 02:28:55.204517 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 156/322] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:28:55 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 38126 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:28:55.206077 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-42bef38a-47f3-40b4-bef0-b5d38a4c04c1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "39a998ea-dea8-49cb-b55b-9dc8f177a3c1"}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:55.207195 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-42bef38a-47f3-40b4-bef0-b5d38a4c04c1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: 55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:55.213590 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-42bef38a-47f3-40b4-bef0-b5d38a4c04c1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:55.214157 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-42bef38a-47f3-40b4-bef0-b5d38a4c04c1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:55.214930 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-42bef38a-47f3-40b4-bef0-b5d38a4c04c1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:55.215360 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-42bef38a-47f3-40b4-bef0-b5d38a4c04c1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:55.218257 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:55.218257 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:55.348955 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3019: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:55.348955 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context, Jul 13 02:28:55.359763 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.wsgi [None req-42bef38a-47f3-40b4-bef0-b5d38a4c04c1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] HTTP exception thrown: Invalid volume: volume 39a998ea-dea8-49cb-b55b-9dc8f177a3c1 is already attached to instances: 55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf Jul 13 02:28:55.360519 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-42bef38a-47f3-40b4-bef0-b5d38a4c04c1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Returning 400 to user: Invalid volume: volume 39a998ea-dea8-49cb-b55b-9dc8f177a3c1 is already attached to instances: 55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf {{(pid=107263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:28:55.360982 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-87d59945-67c0-4a02-a05a-771519f93982 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 30891 microversion: 2.20 time: 0.283814 Jul 13 02:28:55.362237 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-42bef38a-47f3-40b4-bef0-b5d38a4c04c1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "POST /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.159713 Jul 13 02:28:55.366430 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 167/323] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:28:55 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 30891 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 13 02:28:55.375956 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 157/324] 10.222.0.32 () {60 vars in 1323 bytes} [Tue Jul 13 02:28:55 2021] POST /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf/os-volume_attachments => generated 174 bytes in 174 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 13 02:28:55.439511 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-981abcbd-2b90-40eb-b977-ccd220924ad8 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:55.440220 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-981abcbd-2b90-40eb-b977-ccd220924ad8 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:55.447502 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-981abcbd-2b90-40eb-b977-ccd220924ad8 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:55.451547 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-981abcbd-2b90-40eb-b977-ccd220924ad8 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:55.452641 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-981abcbd-2b90-40eb-b977-ccd220924ad8 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:55.453102 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-981abcbd-2b90-40eb-b977-ccd220924ad8 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:55.456495 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:55.456495 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:55.467216 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-055d6cca-1c35-4b3c-a65e-d5d533806459 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:55.467933 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-055d6cca-1c35-4b3c-a65e-d5d533806459 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: 55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:55.474216 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-055d6cca-1c35-4b3c-a65e-d5d533806459 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:55.475404 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-055d6cca-1c35-4b3c-a65e-d5d533806459 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:55.476532 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-055d6cca-1c35-4b3c-a65e-d5d533806459 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:55.477115 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-055d6cca-1c35-4b3c-a65e-d5d533806459 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:55.480572 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:55.480572 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:55.624930 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3031: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:55.624930 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context, Jul 13 02:28:55.633072 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.objects.instance [None req-055d6cca-1c35-4b3c-a65e-d5d533806459 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lazy-loading 'services' on Instance uuid 55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf {{(pid=107263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 13 02:28:55.721820 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-055d6cca-1c35-4b3c-a65e-d5d533806459 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "DELETE /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf/os-volume_attachments/39a998ea-dea8-49cb-b55b-9dc8f177a3c1" status: 202 len: 0 microversion: 2.1 time: 0.258125 Jul 13 02:28:55.727453 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 158/325] 10.222.0.32 () {58 vars in 1416 bytes} [Tue Jul 13 02:28:55 2021] DELETE /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf/os-volume_attachments/39a998ea-dea8-49cb-b55b-9dc8f177a3c1 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 13 02:28:55.799935 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-981abcbd-2b90-40eb-b977-ccd220924ad8 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:55.803296 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:55.803296 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:55.811540 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-981abcbd-2b90-40eb-b977-ccd220924ad8 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1520 microversion: 2.1 time: 0.376307 Jul 13 02:28:55.812222 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 168/326] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:55 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1520 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:55.967668 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-73db1d11-fd01-4e6d-a20c-dd33dd03a6bb tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:55.968433 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-73db1d11-fd01-4e6d-a20c-dd33dd03a6bb tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] [instance: d685507b-3451-47d7-a263-a2ef87d8f116] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:55.975256 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-73db1d11-fd01-4e6d-a20c-dd33dd03a6bb tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:55.975709 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-73db1d11-fd01-4e6d-a20c-dd33dd03a6bb tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:55.976482 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-73db1d11-fd01-4e6d-a20c-dd33dd03a6bb tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:55.977091 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-73db1d11-fd01-4e6d-a20c-dd33dd03a6bb tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:55.980810 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:55.980810 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:56.107816 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-73db1d11-fd01-4e6d-a20c-dd33dd03a6bb tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177c67d168e5457eb50a960f2bff0838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cde6389460449d8b56f7b5098c7b590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:56.111043 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:56.111043 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:56.119716 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-73db1d11-fd01-4e6d-a20c-dd33dd03a6bb tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] 10.222.0.32 "GET /compute/v2.1/servers/d685507b-3451-47d7-a263-a2ef87d8f116" status: 200 len: 1273 microversion: 2.1 time: 0.155403 Jul 13 02:28:56.120099 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 159/327] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:55 2021] GET /compute/v2.1/servers/d685507b-3451-47d7-a263-a2ef87d8f116 => generated 1273 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:56.212944 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-fa5ffd94-b69d-411e-b1e6-6c5e4011a690 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:56.214792 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-fa5ffd94-b69d-411e-b1e6-6c5e4011a690 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:56.221408 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-fa5ffd94-b69d-411e-b1e6-6c5e4011a690 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:56.221911 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-fa5ffd94-b69d-411e-b1e6-6c5e4011a690 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:56.223011 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-fa5ffd94-b69d-411e-b1e6-6c5e4011a690 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:56.223637 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-fa5ffd94-b69d-411e-b1e6-6c5e4011a690 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:56.227962 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:56.227962 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:56.372834 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-a7d79d60-08c4-42fd-beb1-68b263915882 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:56.373803 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-a7d79d60-08c4-42fd-beb1-68b263915882 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:56.388637 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a7d79d60-08c4-42fd-beb1-68b263915882 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:56.389084 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a7d79d60-08c4-42fd-beb1-68b263915882 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:56.389880 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a7d79d60-08c4-42fd-beb1-68b263915882 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:56.390341 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a7d79d60-08c4-42fd-beb1-68b263915882 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:56.396062 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:56.396062 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:56.418937 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-fa5ffd94-b69d-411e-b1e6-6c5e4011a690 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 200 len: 38254 microversion: 2.1 time: 0.209926 Jul 13 02:28:56.420180 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 169/328] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:28:56 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 38254 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:28:56.430671 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-a0212ede-9b5f-407d-90c3-4d27e91c5c29 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:56.431257 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-a0212ede-9b5f-407d-90c3-4d27e91c5c29 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:56.439000 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a0212ede-9b5f-407d-90c3-4d27e91c5c29 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:56.439962 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a0212ede-9b5f-407d-90c3-4d27e91c5c29 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:56.441158 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a0212ede-9b5f-407d-90c3-4d27e91c5c29 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:56.441919 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a0212ede-9b5f-407d-90c3-4d27e91c5c29 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:56.445598 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:56.445598 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:56.514786 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-a0212ede-9b5f-407d-90c3-4d27e91c5c29 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/ips" status: 200 len: 145 microversion: 2.1 time: 0.088883 Jul 13 02:28:56.515366 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 170/329] 10.222.0.32 () {58 vars in 1248 bytes} [Tue Jul 13 02:28:56 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/ips => generated 145 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:28:56.606511 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-a7d79d60-08c4-42fd-beb1-68b263915882 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 31775 microversion: 2.20 time: 0.237080 Jul 13 02:28:56.607164 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 160/330] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:28:56 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 31775 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 13 02:28:56.830502 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-48aa40bd-3ac4-4f85-b833-86eb9c578ee1 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:56.831118 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-48aa40bd-3ac4-4f85-b833-86eb9c578ee1 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:56.844906 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-48aa40bd-3ac4-4f85-b833-86eb9c578ee1 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:56.845627 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-48aa40bd-3ac4-4f85-b833-86eb9c578ee1 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:56.846744 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-48aa40bd-3ac4-4f85-b833-86eb9c578ee1 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:56.847257 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-48aa40bd-3ac4-4f85-b833-86eb9c578ee1 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:56.852786 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:56.852786 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:57.136659 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-d8addb79-5763-4335-b7a4-f974a396d8f0 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:57.138238 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-d8addb79-5763-4335-b7a4-f974a396d8f0 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] [instance: d685507b-3451-47d7-a263-a2ef87d8f116] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:57.145852 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d8addb79-5763-4335-b7a4-f974a396d8f0 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:57.147141 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d8addb79-5763-4335-b7a4-f974a396d8f0 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:57.148250 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d8addb79-5763-4335-b7a4-f974a396d8f0 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:57.148697 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d8addb79-5763-4335-b7a4-f974a396d8f0 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:57.152555 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:57.152555 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:57.194948 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-48aa40bd-3ac4-4f85-b833-86eb9c578ee1 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:57.197514 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:57.197514 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:57.207628 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-48aa40bd-3ac4-4f85-b833-86eb9c578ee1 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1520 microversion: 2.1 time: 0.382603 Jul 13 02:28:57.210804 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 171/331] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:56 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1520 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:57.489707 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-8b58152f-fd23-466c-8d6e-caaa72c7ac05 req-63975fca-7192-4573-aca2-d85454646e57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d685507b-3451-47d7-a263-a2ef87d8f116", "tag": "dc812ec0-21e2-49bb-a037-6c9aadf5274a"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:57.492186 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:28:57.492186 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:28:57.506421 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-8b58152f-fd23-466c-8d6e-caaa72c7ac05 req-63975fca-7192-4573-aca2-d85454646e57 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:57.508611 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-8b58152f-fd23-466c-8d6e-caaa72c7ac05 req-63975fca-7192-4573-aca2-d85454646e57 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:57.525420 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-d8addb79-5763-4335-b7a4-f974a396d8f0 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177c67d168e5457eb50a960f2bff0838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cde6389460449d8b56f7b5098c7b590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:57.535109 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:57.535109 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:57.537447 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-8b58152f-fd23-466c-8d6e-caaa72c7ac05 req-63975fca-7192-4573-aca2-d85454646e57 service nova] Creating event network-changed:dc812ec0-21e2-49bb-a037-6c9aadf5274a for instance d685507b-3451-47d7-a263-a2ef87d8f116 on hv-cinder-78102 Jul 13 02:28:57.547640 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-8b58152f-fd23-466c-8d6e-caaa72c7ac05 req-63975fca-7192-4573-aca2-d85454646e57 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064258 Jul 13 02:28:57.548387 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-d8addb79-5763-4335-b7a4-f974a396d8f0 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] 10.222.0.32 "GET /compute/v2.1/servers/d685507b-3451-47d7-a263-a2ef87d8f116" status: 200 len: 1315 microversion: 2.1 time: 0.415674 Jul 13 02:28:57.549300 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 161/332] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:57 2021] GET /compute/v2.1/servers/d685507b-3451-47d7-a263-a2ef87d8f116 => generated 1315 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:57.551054 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 172/333] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:28:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:28:57.619127 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-c089bbcd-cdb1-4915-8617-84646304459b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:57.623851 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-c089bbcd-cdb1-4915-8617-84646304459b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:57.631587 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c089bbcd-cdb1-4915-8617-84646304459b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:57.632230 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c089bbcd-cdb1-4915-8617-84646304459b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:57.633632 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c089bbcd-cdb1-4915-8617-84646304459b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:57.634709 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c089bbcd-cdb1-4915-8617-84646304459b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:57.638657 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:57.638657 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:57.798721 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-c089bbcd-cdb1-4915-8617-84646304459b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 32409 microversion: 2.20 time: 0.183768 Jul 13 02:28:57.799876 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 162/334] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:28:57 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 32409 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:28:58.196905 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-de8c9433-ec57-4900-8694-6f5bbb939731 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-235244251", "imageRef": "1a3efd47-3618-4abd-b00b-a9fa9b90b4d4", "flavorRef": "452", "networks": [{"uuid": "bbf39b0f-a6a8-4156-9bab-028e4f2bf745"}]}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:58.228202 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-c031ac7b-5e33-48e9-8fcc-6994c7d1d2fb tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:58.228752 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-c031ac7b-5e33-48e9-8fcc-6994c7d1d2fb tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:58.235276 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c031ac7b-5e33-48e9-8fcc-6994c7d1d2fb tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:58.236071 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c031ac7b-5e33-48e9-8fcc-6994c7d1d2fb tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:58.237805 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c031ac7b-5e33-48e9-8fcc-6994c7d1d2fb tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:58.238753 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c031ac7b-5e33-48e9-8fcc-6994c7d1d2fb tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:58.243906 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:58.243906 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:58.280951 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.network.neutron [None req-de8c9433-ec57-4900-8694-6f5bbb939731 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] validate_networks() for [('bbf39b0f-a6a8-4156-9bab-028e4f2bf745', None, None, None)] {{(pid=107262) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Jul 13 02:28:58.660542 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-c031ac7b-5e33-48e9-8fcc-6994c7d1d2fb tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:58.664946 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:58.664946 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:58.674369 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-c031ac7b-5e33-48e9-8fcc-6994c7d1d2fb tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1520 microversion: 2.1 time: 0.451755 Jul 13 02:28:58.675711 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 163/335] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:58 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1520 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:58.680974 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-452dd385-e7e6-453a-8c23-32cc212ab55b tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:58.681850 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-452dd385-e7e6-453a-8c23-32cc212ab55b tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] [instance: d685507b-3451-47d7-a263-a2ef87d8f116] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:58.687962 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-452dd385-e7e6-453a-8c23-32cc212ab55b tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:58.688602 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-452dd385-e7e6-453a-8c23-32cc212ab55b tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:58.689522 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-452dd385-e7e6-453a-8c23-32cc212ab55b tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:58.690160 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-452dd385-e7e6-453a-8c23-32cc212ab55b tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:58.693460 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:58.693460 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:59.091455 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-de8c9433-ec57-4900-8694-6f5bbb939731 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Flavor limits 0:0:0 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 02:28:59.092860 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-de8c9433-ec57-4900-8694-6f5bbb939731 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Image limits 0:0:0 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 02:28:59.093493 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-de8c9433-ec57-4900-8694-6f5bbb939731 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Flavor pref 0:0:0 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 02:28:59.094065 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-de8c9433-ec57-4900-8694-6f5bbb939731 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Image pref 0:0:0 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 02:28:59.098458 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-de8c9433-ec57-4900-8694-6f5bbb939731 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 02:28:59.109284 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2690: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:59.109284 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: user_quotas = model_query(context, models.ProjectUserQuota, Jul 13 02:28:59.119196 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-de8c9433-ec57-4900-8694-6f5bbb939731 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:59.119637 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-de8c9433-ec57-4900-8694-6f5bbb939731 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:59.120432 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-de8c9433-ec57-4900-8694-6f5bbb939731 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:59.120911 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-de8c9433-ec57-4900-8694-6f5bbb939731 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:59.126463 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/objects/instance.py:1537: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:59.126463 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: project_result = project_query.first() Jul 13 02:28:59.140105 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2708: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:59.140105 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: rows = model_query(context, models.Quota, read_deleted="no").\ Jul 13 02:28:59.143754 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.quota [None req-de8c9433-ec57-4900-8694-6f5bbb939731 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Getting quotas for project 6b3bcc4decdb4d42a7f3efd99887e102. Resources: {'ram', 'cores', 'instances'} {{(pid=107262) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 13 02:28:59.148425 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.quota [None req-de8c9433-ec57-4900-8694-6f5bbb939731 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Getting quotas for user f236dcca98c04f60aa827231eede0815 and project 6b3bcc4decdb4d42a7f3efd99887e102. Resources: {'ram', 'cores', 'instances'} {{(pid=107262) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 13 02:28:59.161015 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-de8c9433-ec57-4900-8694-6f5bbb939731 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Going to run 1 instances... {{(pid=107262) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 13 02:28:59.163995 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-de8c9433-ec57-4900-8694-6f5bbb939731 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: e522ea39-8cb0-4f4f-8346-d951228edeaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a3efd47-3618-4abd-b00b-a9fa9b90b4d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107262) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 13 02:28:59.219962 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-452dd385-e7e6-453a-8c23-32cc212ab55b tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177c67d168e5457eb50a960f2bff0838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cde6389460449d8b56f7b5098c7b590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:59.222656 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:59.222656 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:59.231828 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-de8c9433-ec57-4900-8694-6f5bbb939731 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.038141 Jul 13 02:28:59.232839 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-452dd385-e7e6-453a-8c23-32cc212ab55b tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] 10.222.0.32 "GET /compute/v2.1/servers/d685507b-3451-47d7-a263-a2ef87d8f116" status: 200 len: 1315 microversion: 2.1 time: 0.555732 Jul 13 02:28:59.233415 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 164/336] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:58 2021] GET /compute/v2.1/servers/d685507b-3451-47d7-a263-a2ef87d8f116 => generated 1315 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:59.242812 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 173/337] 10.222.0.32 () {60 vars in 1147 bytes} [Tue Jul 13 02:28:58 2021] POST /compute/v2.1/servers => generated 380 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 02:28:59.253951 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-08f2c381-1862-4907-b5ea-d92a32ce320e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c97ae636-48e5-4d15-bd95-e3e47f72dc15"}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:59.255177 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-08f2c381-1862-4907-b5ea-d92a32ce320e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:59.255896 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-2e1245db-2d78-4001-b084-546ec4b82216 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:28:59.256804 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-2e1245db-2d78-4001-b084-546ec4b82216 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:59.264058 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-08f2c381-1862-4907-b5ea-d92a32ce320e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:59.264852 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-08f2c381-1862-4907-b5ea-d92a32ce320e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:59.266702 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-08f2c381-1862-4907-b5ea-d92a32ce320e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:59.267306 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-08f2c381-1862-4907-b5ea-d92a32ce320e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:59.271069 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:59.271069 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:59.275419 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2e1245db-2d78-4001-b084-546ec4b82216 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:59.275873 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2e1245db-2d78-4001-b084-546ec4b82216 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:59.276654 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2e1245db-2d78-4001-b084-546ec4b82216 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:59.277086 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2e1245db-2d78-4001-b084-546ec4b82216 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:59.288595 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:59.288595 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:59.431451 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3019: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:59.431451 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context, Jul 13 02:28:59.499632 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-2e1245db-2d78-4001-b084-546ec4b82216 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 32960 microversion: 2.20 time: 0.247135 Jul 13 02:28:59.506776 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 165/338] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:28:59 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 32960 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:28:59.511966 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-80fbf357-fd5b-40a1-959e-19edf309afd5 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:59.512638 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-80fbf357-fd5b-40a1-959e-19edf309afd5 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: e522ea39-8cb0-4f4f-8346-d951228edeaf] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:59.550067 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2940: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:59.550067 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: query.update(values) Jul 13 02:28:59.552891 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2941: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:59.552891 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return query.first() Jul 13 02:28:59.574587 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-80fbf357-fd5b-40a1-959e-19edf309afd5 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:59.578635 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:59.578635 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:59.588947 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-80fbf357-fd5b-40a1-959e-19edf309afd5 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf" status: 200 len: 1217 microversion: 2.1 time: 0.080644 Jul 13 02:28:59.589514 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 166/339] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:59 2021] GET /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:28:59.648763 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2940: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:59.648763 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: query.update(values) Jul 13 02:28:59.651450 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2941: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:59.651450 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return query.first() Jul 13 02:28:59.672763 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-08f2c381-1862-4907-b5ea-d92a32ce320e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.423815 Jul 13 02:28:59.673782 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 174/340] 10.222.0.32 () {60 vars in 1323 bytes} [Tue Jul 13 02:28:59 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/os-volume_attachments => generated 194 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:28:59.695259 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-7195270b-6ba7-4fd0-9761-d5a4780946ba tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:28:59.696263 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-7195270b-6ba7-4fd0-9761-d5a4780946ba tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:28:59.702606 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7195270b-6ba7-4fd0-9761-d5a4780946ba tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:59.703255 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7195270b-6ba7-4fd0-9761-d5a4780946ba tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:59.704053 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7195270b-6ba7-4fd0-9761-d5a4780946ba tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:28:59.704656 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7195270b-6ba7-4fd0-9761-d5a4780946ba tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:28:59.707579 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:59.707579 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:28:59.889124 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-7195270b-6ba7-4fd0-9761-d5a4780946ba tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:28:59.891720 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:28:59.891720 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:28:59.898796 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-7195270b-6ba7-4fd0-9761-d5a4780946ba tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1520 microversion: 2.1 time: 0.210491 Jul 13 02:28:59.902060 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 167/341] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:28:59 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:00.250615 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-c5135ff6-d9a2-4ed7-ad1b-7a44e3f0a44a tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:00.251344 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-c5135ff6-d9a2-4ed7-ad1b-7a44e3f0a44a tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] [instance: d685507b-3451-47d7-a263-a2ef87d8f116] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:00.258328 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c5135ff6-d9a2-4ed7-ad1b-7a44e3f0a44a tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:00.258774 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c5135ff6-d9a2-4ed7-ad1b-7a44e3f0a44a tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:00.259540 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c5135ff6-d9a2-4ed7-ad1b-7a44e3f0a44a tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:00.259969 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c5135ff6-d9a2-4ed7-ad1b-7a44e3f0a44a tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:00.263125 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:00.263125 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:00.436492 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-c5135ff6-d9a2-4ed7-ad1b-7a44e3f0a44a tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177c67d168e5457eb50a960f2bff0838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cde6389460449d8b56f7b5098c7b590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:00.439049 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:00.439049 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:00.446344 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-c5135ff6-d9a2-4ed7-ad1b-7a44e3f0a44a tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] 10.222.0.32 "GET /compute/v2.1/servers/d685507b-3451-47d7-a263-a2ef87d8f116" status: 200 len: 1315 microversion: 2.1 time: 0.199774 Jul 13 02:29:00.446902 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 175/342] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:00 2021] GET /compute/v2.1/servers/d685507b-3451-47d7-a263-a2ef87d8f116 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:00.513117 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-c0725cdd-a8af-45cf-b117-ad20e9df5a51 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:29:00.514208 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-c0725cdd-a8af-45cf-b117-ad20e9df5a51 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:00.520466 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c0725cdd-a8af-45cf-b117-ad20e9df5a51 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:00.520916 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c0725cdd-a8af-45cf-b117-ad20e9df5a51 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:00.522526 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c0725cdd-a8af-45cf-b117-ad20e9df5a51 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:00.522961 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c0725cdd-a8af-45cf-b117-ad20e9df5a51 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:00.526113 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:00.526113 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:00.606251 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-fdaed324-0c78-4ad7-afa0-d1477fbf83e1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:00.606959 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-fdaed324-0c78-4ad7-afa0-d1477fbf83e1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: e522ea39-8cb0-4f4f-8346-d951228edeaf] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:00.613214 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-fdaed324-0c78-4ad7-afa0-d1477fbf83e1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:00.613663 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-fdaed324-0c78-4ad7-afa0-d1477fbf83e1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:00.615489 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-fdaed324-0c78-4ad7-afa0-d1477fbf83e1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:00.615489 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-fdaed324-0c78-4ad7-afa0-d1477fbf83e1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:00.618327 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:00.618327 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:00.709704 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-c0725cdd-a8af-45cf-b117-ad20e9df5a51 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 33339 microversion: 2.20 time: 0.199574 Jul 13 02:29:00.711649 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 168/343] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:29:00 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 33339 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 13 02:29:00.736128 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-fdaed324-0c78-4ad7-afa0-d1477fbf83e1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:00.739638 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:00.739638 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:00.748642 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-fdaed324-0c78-4ad7-afa0-d1477fbf83e1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf" status: 200 len: 1277 microversion: 2.1 time: 0.146587 Jul 13 02:29:00.749875 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 176/344] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:00 2021] GET /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf => generated 1277 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:29:00.915604 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-b264b01f-bdc2-45b1-ac18-d1b03b4416d0 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:00.916073 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-b264b01f-bdc2-45b1-ac18-d1b03b4416d0 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:00.922776 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b264b01f-bdc2-45b1-ac18-d1b03b4416d0 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:00.923227 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b264b01f-bdc2-45b1-ac18-d1b03b4416d0 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:00.924001 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b264b01f-bdc2-45b1-ac18-d1b03b4416d0 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:00.924435 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b264b01f-bdc2-45b1-ac18-d1b03b4416d0 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:00.928063 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:00.928063 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:01.439141 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-b264b01f-bdc2-45b1-ac18-d1b03b4416d0 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:01.441688 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:01.441688 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:01.449028 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-b264b01f-bdc2-45b1-ac18-d1b03b4416d0 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1520 microversion: 2.1 time: 0.537644 Jul 13 02:29:01.449528 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 169/345] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:00 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1520 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:01.463185 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-ee7ad01d-ca75-4a39-87c1-0cbf4883f9cb tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:01.463895 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-ee7ad01d-ca75-4a39-87c1-0cbf4883f9cb tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] [instance: d685507b-3451-47d7-a263-a2ef87d8f116] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:01.469811 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ee7ad01d-ca75-4a39-87c1-0cbf4883f9cb tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:01.470298 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ee7ad01d-ca75-4a39-87c1-0cbf4883f9cb tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:01.471073 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ee7ad01d-ca75-4a39-87c1-0cbf4883f9cb tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:01.471508 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ee7ad01d-ca75-4a39-87c1-0cbf4883f9cb tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:01.474673 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:01.474673 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:01.722938 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-a009cf62-179d-4cff-afff-45321cdae808 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:29:01.724009 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-a009cf62-179d-4cff-afff-45321cdae808 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:01.731817 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a009cf62-179d-4cff-afff-45321cdae808 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:01.732779 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a009cf62-179d-4cff-afff-45321cdae808 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:01.733711 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a009cf62-179d-4cff-afff-45321cdae808 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:01.734274 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a009cf62-179d-4cff-afff-45321cdae808 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:01.737301 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:01.737301 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:01.753534 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-ee7ad01d-ca75-4a39-87c1-0cbf4883f9cb tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177c67d168e5457eb50a960f2bff0838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cde6389460449d8b56f7b5098c7b590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:01.758242 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:01.758242 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:01.771044 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-ee7ad01d-ca75-4a39-87c1-0cbf4883f9cb tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] 10.222.0.32 "GET /compute/v2.1/servers/d685507b-3451-47d7-a263-a2ef87d8f116" status: 200 len: 1315 microversion: 2.1 time: 0.312184 Jul 13 02:29:01.782200 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 177/346] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:01 2021] GET /compute/v2.1/servers/d685507b-3451-47d7-a263-a2ef87d8f116 => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:29:01.788075 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-6a1c32c4-949d-44f2-8ecc-43a90e251fdb tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:01.789249 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-6a1c32c4-949d-44f2-8ecc-43a90e251fdb tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: e522ea39-8cb0-4f4f-8346-d951228edeaf] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:01.796179 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-6a1c32c4-949d-44f2-8ecc-43a90e251fdb tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:01.797469 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-6a1c32c4-949d-44f2-8ecc-43a90e251fdb tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:01.798293 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-6a1c32c4-949d-44f2-8ecc-43a90e251fdb tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:01.798896 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-6a1c32c4-949d-44f2-8ecc-43a90e251fdb tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:01.803104 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:01.803104 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:01.933522 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-a009cf62-179d-4cff-afff-45321cdae808 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 34049 microversion: 2.20 time: 0.214570 Jul 13 02:29:01.939667 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 170/347] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:29:01 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 34049 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:29:02.124994 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-6a1c32c4-949d-44f2-8ecc-43a90e251fdb tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:02.127891 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:02.127891 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:02.138814 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-6a1c32c4-949d-44f2-8ecc-43a90e251fdb tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf" status: 200 len: 1317 microversion: 2.1 time: 0.355180 Jul 13 02:29:02.139726 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 178/348] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:01 2021] GET /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf => generated 1317 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:02.467544 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-6c2a8c37-5cf3-4d38-8b0e-adcdbe6e3b67 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:02.468171 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-6c2a8c37-5cf3-4d38-8b0e-adcdbe6e3b67 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:02.477968 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6c2a8c37-5cf3-4d38-8b0e-adcdbe6e3b67 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:02.478845 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6c2a8c37-5cf3-4d38-8b0e-adcdbe6e3b67 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:02.479873 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6c2a8c37-5cf3-4d38-8b0e-adcdbe6e3b67 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:02.480621 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6c2a8c37-5cf3-4d38-8b0e-adcdbe6e3b67 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:02.484986 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:02.484986 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:02.739927 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-6c2a8c37-5cf3-4d38-8b0e-adcdbe6e3b67 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:02.743589 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:02.743589 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:02.750584 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-6c2a8c37-5cf3-4d38-8b0e-adcdbe6e3b67 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1520 microversion: 2.1 time: 0.287025 Jul 13 02:29:02.751084 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 171/349] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:02 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1520 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:29:02.788071 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-ef827e5d-e475-4858-b3f6-c09439812a1c req-bdf0050e-8d94-46c8-b780-fd377ad49d48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e522ea39-8cb0-4f4f-8346-d951228edeaf", "tag": "1331fe83-6765-4c69-b422-419458955d3f"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:29:02.789163 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-5d5e348d-2c37-4bc2-90e2-eccbdc590d76 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:02.790115 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-5d5e348d-2c37-4bc2-90e2-eccbdc590d76 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] [instance: d685507b-3451-47d7-a263-a2ef87d8f116] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:02.790211 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:29:02.790211 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:29:02.796942 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5d5e348d-2c37-4bc2-90e2-eccbdc590d76 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:02.797864 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-ef827e5d-e475-4858-b3f6-c09439812a1c req-bdf0050e-8d94-46c8-b780-fd377ad49d48 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:02.798001 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5d5e348d-2c37-4bc2-90e2-eccbdc590d76 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:02.798755 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-ef827e5d-e475-4858-b3f6-c09439812a1c req-bdf0050e-8d94-46c8-b780-fd377ad49d48 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:02.799499 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5d5e348d-2c37-4bc2-90e2-eccbdc590d76 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:02.800239 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5d5e348d-2c37-4bc2-90e2-eccbdc590d76 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:02.806273 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:02.806273 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:02.813751 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-ef827e5d-e475-4858-b3f6-c09439812a1c req-bdf0050e-8d94-46c8-b780-fd377ad49d48 service nova] Creating event network-changed:1331fe83-6765-4c69-b422-419458955d3f for instance e522ea39-8cb0-4f4f-8346-d951228edeaf on hv-cinder-78102 Jul 13 02:29:02.818852 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-ef827e5d-e475-4858-b3f6-c09439812a1c req-bdf0050e-8d94-46c8-b780-fd377ad49d48 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036421 Jul 13 02:29:02.822241 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 179/350] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:29:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:29:02.948189 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-1e661a22-722f-4d82-962d-c9c7fa4cee7f tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:29:02.949215 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-1e661a22-722f-4d82-962d-c9c7fa4cee7f tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:02.955771 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1e661a22-722f-4d82-962d-c9c7fa4cee7f tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:02.956623 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1e661a22-722f-4d82-962d-c9c7fa4cee7f tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:02.957603 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1e661a22-722f-4d82-962d-c9c7fa4cee7f tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:02.958269 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1e661a22-722f-4d82-962d-c9c7fa4cee7f tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:02.962168 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:02.962168 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:03.082805 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-5d5e348d-2c37-4bc2-90e2-eccbdc590d76 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177c67d168e5457eb50a960f2bff0838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cde6389460449d8b56f7b5098c7b590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:03.085964 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:03.085964 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:03.092759 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-5d5e348d-2c37-4bc2-90e2-eccbdc590d76 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] 10.222.0.32 "GET /compute/v2.1/servers/d685507b-3451-47d7-a263-a2ef87d8f116" status: 200 len: 1315 microversion: 2.1 time: 0.307703 Jul 13 02:29:03.093325 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 172/351] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:02 2021] GET /compute/v2.1/servers/d685507b-3451-47d7-a263-a2ef87d8f116 => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:03.116466 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-1e661a22-722f-4d82-962d-c9c7fa4cee7f tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 34858 microversion: 2.20 time: 0.172354 Jul 13 02:29:03.117106 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 180/352] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:29:02 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 34858 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 13 02:29:03.156271 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-e34adbf8-6cdf-4f5e-8c26-9b81f776197b tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:03.156887 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-e34adbf8-6cdf-4f5e-8c26-9b81f776197b tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: e522ea39-8cb0-4f4f-8346-d951228edeaf] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:03.163374 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e34adbf8-6cdf-4f5e-8c26-9b81f776197b tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:03.163826 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e34adbf8-6cdf-4f5e-8c26-9b81f776197b tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:03.164598 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e34adbf8-6cdf-4f5e-8c26-9b81f776197b tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:03.165029 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e34adbf8-6cdf-4f5e-8c26-9b81f776197b tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:03.168007 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:03.168007 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:03.420599 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-e34adbf8-6cdf-4f5e-8c26-9b81f776197b tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:03.423496 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:03.423496 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:03.431321 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-e34adbf8-6cdf-4f5e-8c26-9b81f776197b tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf" status: 200 len: 1317 microversion: 2.1 time: 0.278676 Jul 13 02:29:03.431889 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 173/353] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:03 2021] GET /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf => generated 1317 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:03.555639 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-01ed1b75-31b4-4981-821f-79b8c543f648 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "764bd671-ce1c-4114-84f7-f9f49ae0bc7b", "device": "/dev/sdb"}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:29:03.557296 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-01ed1b75-31b4-4981-821f-79b8c543f648 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 97a3e7df-5271-4585-b962-e014adc2c87b] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:03.563718 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-01ed1b75-31b4-4981-821f-79b8c543f648 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:03.564161 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-01ed1b75-31b4-4981-821f-79b8c543f648 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:03.564931 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-01ed1b75-31b4-4981-821f-79b8c543f648 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:03.565363 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-01ed1b75-31b4-4981-821f-79b8c543f648 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:03.568602 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:03.568602 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:03.679892 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3019: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:03.679892 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context, Jul 13 02:29:03.766372 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2940: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:03.766372 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: query.update(values) Jul 13 02:29:03.768788 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2941: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:03.768788 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return query.first() Jul 13 02:29:03.770165 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-bfe73ccc-c3b0-439b-adf2-361fd7a1c468 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:03.770815 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-bfe73ccc-c3b0-439b-adf2-361fd7a1c468 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:03.778445 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-bfe73ccc-c3b0-439b-adf2-361fd7a1c468 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:03.779119 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-bfe73ccc-c3b0-439b-adf2-361fd7a1c468 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:03.779904 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-bfe73ccc-c3b0-439b-adf2-361fd7a1c468 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:03.780327 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-bfe73ccc-c3b0-439b-adf2-361fd7a1c468 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:03.783531 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:03.783531 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:03.870837 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2940: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:03.870837 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: query.update(values) Jul 13 02:29:03.873192 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2941: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:03.873192 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return query.first() Jul 13 02:29:03.893536 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-01ed1b75-31b4-4981-821f-79b8c543f648 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "POST /compute/v2.1/servers/97a3e7df-5271-4585-b962-e014adc2c87b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.341865 Jul 13 02:29:03.894233 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 181/354] 10.222.0.32 () {60 vars in 1323 bytes} [Tue Jul 13 02:29:03 2021] POST /compute/v2.1/servers/97a3e7df-5271-4585-b962-e014adc2c87b/os-volume_attachments => generated 194 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:29:04.069560 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-bfe73ccc-c3b0-439b-adf2-361fd7a1c468 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:04.072118 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:04.072118 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:04.078891 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-bfe73ccc-c3b0-439b-adf2-361fd7a1c468 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1520 microversion: 2.1 time: 0.314311 Jul 13 02:29:04.079459 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 174/355] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:03 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1520 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:29:04.109644 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-8d7cf3f5-1383-4dde-b865-1f670552a319 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:04.110370 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-8d7cf3f5-1383-4dde-b865-1f670552a319 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] [instance: d685507b-3451-47d7-a263-a2ef87d8f116] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:04.117231 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8d7cf3f5-1383-4dde-b865-1f670552a319 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:04.117231 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8d7cf3f5-1383-4dde-b865-1f670552a319 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:04.117833 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8d7cf3f5-1383-4dde-b865-1f670552a319 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:04.118459 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8d7cf3f5-1383-4dde-b865-1f670552a319 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:04.122087 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:04.122087 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:04.128032 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-b3f95d53-b9b5-4c43-b900-dfa7ed1977c3 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:29:04.129020 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-b3f95d53-b9b5-4c43-b900-dfa7ed1977c3 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:04.135305 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b3f95d53-b9b5-4c43-b900-dfa7ed1977c3 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:04.135750 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b3f95d53-b9b5-4c43-b900-dfa7ed1977c3 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:04.136511 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b3f95d53-b9b5-4c43-b900-dfa7ed1977c3 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:04.136952 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b3f95d53-b9b5-4c43-b900-dfa7ed1977c3 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:04.139878 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:04.139878 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:04.298749 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-b3f95d53-b9b5-4c43-b900-dfa7ed1977c3 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 35468 microversion: 2.20 time: 0.174188 Jul 13 02:29:04.298889 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-8d7cf3f5-1383-4dde-b865-1f670552a319 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177c67d168e5457eb50a960f2bff0838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cde6389460449d8b56f7b5098c7b590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:04.299625 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 175/356] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:29:04 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 35468 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 13 02:29:04.301424 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:04.301424 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:04.308264 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-8d7cf3f5-1383-4dde-b865-1f670552a319 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] 10.222.0.32 "GET /compute/v2.1/servers/d685507b-3451-47d7-a263-a2ef87d8f116" status: 200 len: 1315 microversion: 2.1 time: 0.202721 Jul 13 02:29:04.308819 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 182/357] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:04 2021] GET /compute/v2.1/servers/d685507b-3451-47d7-a263-a2ef87d8f116 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:04.448598 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-2894fdaa-f155-450d-a641-27bdf8ccd40f tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:04.449305 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-2894fdaa-f155-450d-a641-27bdf8ccd40f tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: e522ea39-8cb0-4f4f-8346-d951228edeaf] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:04.455755 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2894fdaa-f155-450d-a641-27bdf8ccd40f tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:04.456203 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2894fdaa-f155-450d-a641-27bdf8ccd40f tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:04.456969 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2894fdaa-f155-450d-a641-27bdf8ccd40f tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:04.457422 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2894fdaa-f155-450d-a641-27bdf8ccd40f tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:04.460585 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:04.460585 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:04.632024 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-2894fdaa-f155-450d-a641-27bdf8ccd40f tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:04.634596 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:04.634596 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:04.641850 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-2894fdaa-f155-450d-a641-27bdf8ccd40f tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf" status: 200 len: 1317 microversion: 2.1 time: 0.197277 Jul 13 02:29:04.645134 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 176/358] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:04 2021] GET /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:05.095990 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-50dd8846-6447-468c-b20e-ad5f068edffa tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:05.096598 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-50dd8846-6447-468c-b20e-ad5f068edffa tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:05.103479 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-50dd8846-6447-468c-b20e-ad5f068edffa tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:05.104051 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-50dd8846-6447-468c-b20e-ad5f068edffa tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:05.104885 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-50dd8846-6447-468c-b20e-ad5f068edffa tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:05.105380 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-50dd8846-6447-468c-b20e-ad5f068edffa tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:05.108444 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:05.108444 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:05.278589 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-50dd8846-6447-468c-b20e-ad5f068edffa tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:05.281155 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:05.281155 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:05.287983 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-50dd8846-6447-468c-b20e-ad5f068edffa tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1520 microversion: 2.1 time: 0.195579 Jul 13 02:29:05.288542 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 183/359] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:05 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:05.310752 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-92c9fd61-a5a3-416d-b023-f87ee1dd5631 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:29:05.311658 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-92c9fd61-a5a3-416d-b023-f87ee1dd5631 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:05.317398 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-92c9fd61-a5a3-416d-b023-f87ee1dd5631 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:05.317773 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-92c9fd61-a5a3-416d-b023-f87ee1dd5631 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:05.318953 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-92c9fd61-a5a3-416d-b023-f87ee1dd5631 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:05.319385 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-92c9fd61-a5a3-416d-b023-f87ee1dd5631 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:05.322105 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:05.322105 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:05.324374 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-33ea2245-cc96-4cb3-acd2-a838c3deca78 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:05.325072 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-33ea2245-cc96-4cb3-acd2-a838c3deca78 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] [instance: d685507b-3451-47d7-a263-a2ef87d8f116] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:05.330770 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-33ea2245-cc96-4cb3-acd2-a838c3deca78 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:05.331217 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-33ea2245-cc96-4cb3-acd2-a838c3deca78 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:05.331986 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-33ea2245-cc96-4cb3-acd2-a838c3deca78 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:05.332417 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-33ea2245-cc96-4cb3-acd2-a838c3deca78 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:05.335817 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:05.335817 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:05.472259 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-92c9fd61-a5a3-416d-b023-f87ee1dd5631 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 36479 microversion: 2.20 time: 0.165004 Jul 13 02:29:05.473241 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 177/360] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:29:05 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 36479 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:29:05.508578 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-33ea2245-cc96-4cb3-acd2-a838c3deca78 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177c67d168e5457eb50a960f2bff0838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cde6389460449d8b56f7b5098c7b590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:05.511156 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:05.511156 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:05.518170 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-33ea2245-cc96-4cb3-acd2-a838c3deca78 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] 10.222.0.32 "GET /compute/v2.1/servers/d685507b-3451-47d7-a263-a2ef87d8f116" status: 200 len: 1315 microversion: 2.1 time: 0.197390 Jul 13 02:29:05.518730 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 184/361] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:05 2021] GET /compute/v2.1/servers/d685507b-3451-47d7-a263-a2ef87d8f116 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:29:05.659539 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-4068736a-9b31-4ab6-823b-e5c4bb12ad91 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:05.660166 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-4068736a-9b31-4ab6-823b-e5c4bb12ad91 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: e522ea39-8cb0-4f4f-8346-d951228edeaf] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:05.666677 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4068736a-9b31-4ab6-823b-e5c4bb12ad91 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:05.667125 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4068736a-9b31-4ab6-823b-e5c4bb12ad91 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:05.667904 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4068736a-9b31-4ab6-823b-e5c4bb12ad91 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:05.668337 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4068736a-9b31-4ab6-823b-e5c4bb12ad91 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:05.671205 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:05.671205 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:05.847405 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-4068736a-9b31-4ab6-823b-e5c4bb12ad91 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:05.850137 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:05.850137 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:05.858003 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-4068736a-9b31-4ab6-823b-e5c4bb12ad91 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf" status: 200 len: 1317 microversion: 2.1 time: 0.202477 Jul 13 02:29:05.859342 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 178/362] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:05 2021] GET /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf => generated 1317 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:29:05.889038 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-87522b00-c83c-4655-9b50-f97558ef697e req-de3cc5b4-8488-43b6-b772-ee564a412dc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d685507b-3451-47d7-a263-a2ef87d8f116", "name": "network-vif-plugged", "status": "completed", "tag": "dc812ec0-21e2-49bb-a037-6c9aadf5274a"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:29:05.892310 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:29:05.892310 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:29:05.903542 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-87522b00-c83c-4655-9b50-f97558ef697e req-de3cc5b4-8488-43b6-b772-ee564a412dc9 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:05.904364 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-87522b00-c83c-4655-9b50-f97558ef697e req-de3cc5b4-8488-43b6-b772-ee564a412dc9 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:05.924861 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-87522b00-c83c-4655-9b50-f97558ef697e req-de3cc5b4-8488-43b6-b772-ee564a412dc9 service nova] Creating event network-vif-plugged:dc812ec0-21e2-49bb-a037-6c9aadf5274a for instance d685507b-3451-47d7-a263-a2ef87d8f116 on hv-cinder-78102 Jul 13 02:29:05.933186 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-87522b00-c83c-4655-9b50-f97558ef697e req-de3cc5b4-8488-43b6-b772-ee564a412dc9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048937 Jul 13 02:29:05.934265 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 185/363] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:29:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:29:06.304518 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-a0f68a38-ca81-4af0-ae83-c379fa7f8570 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:06.305249 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-a0f68a38-ca81-4af0-ae83-c379fa7f8570 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:06.311278 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a0f68a38-ca81-4af0-ae83-c379fa7f8570 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:06.311899 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a0f68a38-ca81-4af0-ae83-c379fa7f8570 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:06.312529 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a0f68a38-ca81-4af0-ae83-c379fa7f8570 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:06.312971 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a0f68a38-ca81-4af0-ae83-c379fa7f8570 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:06.315926 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:06.315926 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:06.485151 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-f25dc670-c6bd-4371-a21a-c5d92eadee9e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:29:06.486216 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-f25dc670-c6bd-4371-a21a-c5d92eadee9e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:06.492207 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f25dc670-c6bd-4371-a21a-c5d92eadee9e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:06.492588 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f25dc670-c6bd-4371-a21a-c5d92eadee9e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:06.493355 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f25dc670-c6bd-4371-a21a-c5d92eadee9e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:06.493786 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f25dc670-c6bd-4371-a21a-c5d92eadee9e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:06.496484 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:06.496484 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:06.512563 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-a0f68a38-ca81-4af0-ae83-c379fa7f8570 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:06.515480 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:06.515480 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:06.523811 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-a0f68a38-ca81-4af0-ae83-c379fa7f8570 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1520 microversion: 2.1 time: 0.222900 Jul 13 02:29:06.524407 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 179/364] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:06 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1520 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:06.534437 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-67e2c373-e49f-4bd8-b33d-03d1719f18c0 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:06.535030 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-67e2c373-e49f-4bd8-b33d-03d1719f18c0 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] [instance: d685507b-3451-47d7-a263-a2ef87d8f116] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:06.541287 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-67e2c373-e49f-4bd8-b33d-03d1719f18c0 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:06.541727 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-67e2c373-e49f-4bd8-b33d-03d1719f18c0 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:06.542543 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-67e2c373-e49f-4bd8-b33d-03d1719f18c0 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:06.542974 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-67e2c373-e49f-4bd8-b33d-03d1719f18c0 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:06.545794 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:06.545794 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:06.717565 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-67e2c373-e49f-4bd8-b33d-03d1719f18c0 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177c67d168e5457eb50a960f2bff0838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cde6389460449d8b56f7b5098c7b590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:06.720197 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:06.720197 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:06.727603 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-67e2c373-e49f-4bd8-b33d-03d1719f18c0 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] 10.222.0.32 "GET /compute/v2.1/servers/d685507b-3451-47d7-a263-a2ef87d8f116" status: 200 len: 1315 microversion: 2.1 time: 0.196587 Jul 13 02:29:06.728159 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 180/365] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:06 2021] GET /compute/v2.1/servers/d685507b-3451-47d7-a263-a2ef87d8f116 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:06.851823 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-f25dc670-c6bd-4371-a21a-c5d92eadee9e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 37289 microversion: 2.20 time: 0.370631 Jul 13 02:29:06.852755 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 186/366] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:29:06 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 37289 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 13 02:29:06.883357 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-e8b2766c-c95e-45d3-b7e5-1e766f800079 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:06.883958 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-e8b2766c-c95e-45d3-b7e5-1e766f800079 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: e522ea39-8cb0-4f4f-8346-d951228edeaf] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:06.890156 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e8b2766c-c95e-45d3-b7e5-1e766f800079 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:06.890603 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e8b2766c-c95e-45d3-b7e5-1e766f800079 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:06.891364 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e8b2766c-c95e-45d3-b7e5-1e766f800079 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:06.891784 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e8b2766c-c95e-45d3-b7e5-1e766f800079 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:06.894810 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:06.894810 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:07.179782 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-e8b2766c-c95e-45d3-b7e5-1e766f800079 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:07.182875 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:07.182875 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:07.190059 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-e8b2766c-c95e-45d3-b7e5-1e766f800079 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf" status: 200 len: 1317 microversion: 2.1 time: 0.310217 Jul 13 02:29:07.192388 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 181/367] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:06 2021] GET /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf => generated 1317 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:07.541754 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-a3588510-a423-4d97-a99c-8d5584bc6eca tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:07.542489 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-a3588510-a423-4d97-a99c-8d5584bc6eca tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:07.549124 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a3588510-a423-4d97-a99c-8d5584bc6eca tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:07.549575 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a3588510-a423-4d97-a99c-8d5584bc6eca tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:07.550473 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a3588510-a423-4d97-a99c-8d5584bc6eca tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:07.550906 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a3588510-a423-4d97-a99c-8d5584bc6eca tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:07.553859 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:07.553859 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:07.740921 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-a3588510-a423-4d97-a99c-8d5584bc6eca tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:07.745228 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-ffb3d71b-4a95-4e4a-acd3-19f1b3a53808 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:07.745847 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-ffb3d71b-4a95-4e4a-acd3-19f1b3a53808 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] [instance: d685507b-3451-47d7-a263-a2ef87d8f116] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:07.747128 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:07.747128 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:07.752794 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ffb3d71b-4a95-4e4a-acd3-19f1b3a53808 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:07.753446 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ffb3d71b-4a95-4e4a-acd3-19f1b3a53808 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:07.754482 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ffb3d71b-4a95-4e4a-acd3-19f1b3a53808 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:07.755176 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ffb3d71b-4a95-4e4a-acd3-19f1b3a53808 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:07.759761 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:07.759761 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:07.773040 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-a3588510-a423-4d97-a99c-8d5584bc6eca tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1520 microversion: 2.1 time: 0.235951 Jul 13 02:29:07.773639 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 187/368] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:07 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1520 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:07.864071 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-ce081dc5-870a-4854-be34-66c40b4aff60 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:29:07.865025 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-ce081dc5-870a-4854-be34-66c40b4aff60 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:07.870804 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ce081dc5-870a-4854-be34-66c40b4aff60 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:07.871244 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ce081dc5-870a-4854-be34-66c40b4aff60 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:07.872526 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ce081dc5-870a-4854-be34-66c40b4aff60 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:07.873156 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ce081dc5-870a-4854-be34-66c40b4aff60 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:07.875927 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:07.875927 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:07.942608 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-ffb3d71b-4a95-4e4a-acd3-19f1b3a53808 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177c67d168e5457eb50a960f2bff0838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cde6389460449d8b56f7b5098c7b590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:07.947561 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:07.947561 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:07.955048 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-ffb3d71b-4a95-4e4a-acd3-19f1b3a53808 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] 10.222.0.32 "GET /compute/v2.1/servers/d685507b-3451-47d7-a263-a2ef87d8f116" status: 200 len: 1315 microversion: 2.1 time: 0.214164 Jul 13 02:29:07.955765 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 182/369] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:07 2021] GET /compute/v2.1/servers/d685507b-3451-47d7-a263-a2ef87d8f116 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:08.078466 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-ce081dc5-870a-4854-be34-66c40b4aff60 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 37814 microversion: 2.20 time: 0.218001 Jul 13 02:29:08.079144 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 188/370] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:29:07 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 37814 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 13 02:29:08.207466 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-6c1bb0e9-044d-4b18-84fc-864975dac841 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:08.208078 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-6c1bb0e9-044d-4b18-84fc-864975dac841 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: e522ea39-8cb0-4f4f-8346-d951228edeaf] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:08.214401 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6c1bb0e9-044d-4b18-84fc-864975dac841 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:08.214849 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6c1bb0e9-044d-4b18-84fc-864975dac841 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:08.215615 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6c1bb0e9-044d-4b18-84fc-864975dac841 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:08.216045 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6c1bb0e9-044d-4b18-84fc-864975dac841 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:08.218939 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:08.218939 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:08.316871 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-ada2c2d5-dc6b-4bfb-98ca-478903a2aab0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:29:08.325794 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ada2c2d5-dc6b-4bfb-98ca-478903a2aab0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:08.326271 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ada2c2d5-dc6b-4bfb-98ca-478903a2aab0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:08.328887 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:08.328887 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:08.394756 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-ada2c2d5-dc6b-4bfb-98ca-478903a2aab0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Going to try to stop instance {{(pid=107262) force_stop /opt/stack/nova/nova/compute/api.py:2582}} Jul 13 02:29:08.399767 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:08.399767 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:08.420066 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-6c1bb0e9-044d-4b18-84fc-864975dac841 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:08.422942 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:08.422942 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:08.429998 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-6c1bb0e9-044d-4b18-84fc-864975dac841 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf" status: 200 len: 1317 microversion: 2.1 time: 0.226263 Jul 13 02:29:08.430653 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 183/371] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:08 2021] GET /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf => generated 1317 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:08.459873 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/update_match.py:472: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:08.459873 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = query.session.execute(update_stmt) Jul 13 02:29:08.482263 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-ada2c2d5-dc6b-4bfb-98ca-478903a2aab0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 202 len: 0 microversion: 2.1 time: 0.169203 Jul 13 02:29:08.482850 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 189/372] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:29:08 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 13 02:29:08.491460 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-56a4a413-db68-4661-9974-55dc9699d56e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:08.492061 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-56a4a413-db68-4661-9974-55dc9699d56e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:08.497756 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-56a4a413-db68-4661-9974-55dc9699d56e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:08.498233 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-56a4a413-db68-4661-9974-55dc9699d56e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:08.498990 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-56a4a413-db68-4661-9974-55dc9699d56e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:08.499419 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-56a4a413-db68-4661-9974-55dc9699d56e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:08.502309 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:08.502309 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:08.704225 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-56a4a413-db68-4661-9974-55dc9699d56e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:08.707260 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:08.707260 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:08.719936 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-56a4a413-db68-4661-9974-55dc9699d56e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1724 microversion: 2.1 time: 0.228337 Jul 13 02:29:08.719936 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 184/373] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:08 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:08.791590 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-c886e098-4b5f-4544-9043-3a0bd4aadd29 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:08.792286 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-c886e098-4b5f-4544-9043-3a0bd4aadd29 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:08.798232 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c886e098-4b5f-4544-9043-3a0bd4aadd29 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:08.798692 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c886e098-4b5f-4544-9043-3a0bd4aadd29 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:08.799456 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c886e098-4b5f-4544-9043-3a0bd4aadd29 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:08.799892 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c886e098-4b5f-4544-9043-3a0bd4aadd29 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:08.803492 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:08.803492 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:08.972050 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-62344bfb-3f5c-4e9a-889a-69670dbb6fbb tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:08.972573 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-62344bfb-3f5c-4e9a-889a-69670dbb6fbb tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] [instance: d685507b-3451-47d7-a263-a2ef87d8f116] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:08.979019 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-62344bfb-3f5c-4e9a-889a-69670dbb6fbb tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:08.979463 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-62344bfb-3f5c-4e9a-889a-69670dbb6fbb tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:08.980255 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-62344bfb-3f5c-4e9a-889a-69670dbb6fbb tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:08.980682 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-62344bfb-3f5c-4e9a-889a-69670dbb6fbb tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:08.983858 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:08.983858 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:08.986281 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-c886e098-4b5f-4544-9043-3a0bd4aadd29 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:08.990772 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:08.990772 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:08.998563 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-c886e098-4b5f-4544-9043-3a0bd4aadd29 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1520 microversion: 2.1 time: 0.211735 Jul 13 02:29:08.999136 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 190/374] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:08 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1520 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:09.091224 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-c706cfad-68ec-41cc-881b-dbf187ba5a22 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:29:09.092686 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-c706cfad-68ec-41cc-881b-dbf187ba5a22 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:09.098437 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c706cfad-68ec-41cc-881b-dbf187ba5a22 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:09.098884 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c706cfad-68ec-41cc-881b-dbf187ba5a22 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:09.099702 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c706cfad-68ec-41cc-881b-dbf187ba5a22 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:09.100712 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c706cfad-68ec-41cc-881b-dbf187ba5a22 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:09.103610 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:09.103610 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:09.160547 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-62344bfb-3f5c-4e9a-889a-69670dbb6fbb tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177c67d168e5457eb50a960f2bff0838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cde6389460449d8b56f7b5098c7b590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:09.163908 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:09.163908 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:09.170768 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-62344bfb-3f5c-4e9a-889a-69670dbb6fbb tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] 10.222.0.32 "GET /compute/v2.1/servers/d685507b-3451-47d7-a263-a2ef87d8f116" status: 200 len: 1464 microversion: 2.1 time: 0.202392 Jul 13 02:29:09.171336 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 185/375] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:08 2021] GET /compute/v2.1/servers/d685507b-3451-47d7-a263-a2ef87d8f116 => generated 1464 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:29:09.208367 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-0de69c62-7e54-493a-b480-08b528fa14dc tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:09.209674 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-0de69c62-7e54-493a-b480-08b528fa14dc tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] [instance: d685507b-3451-47d7-a263-a2ef87d8f116] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:09.216210 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0de69c62-7e54-493a-b480-08b528fa14dc tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:09.216655 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0de69c62-7e54-493a-b480-08b528fa14dc tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:09.217424 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0de69c62-7e54-493a-b480-08b528fa14dc tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:09.217853 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0de69c62-7e54-493a-b480-08b528fa14dc tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:09.220833 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:09.220833 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:09.285694 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-0de69c62-7e54-493a-b480-08b528fa14dc tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] [instance: d685507b-3451-47d7-a263-a2ef87d8f116] Going to try to terminate instance {{(pid=107263) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 13 02:29:09.288352 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3008: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:09.288352 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).\ Jul 13 02:29:09.300667 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:09.300667 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:09.358326 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-c706cfad-68ec-41cc-881b-dbf187ba5a22 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 38130 microversion: 2.20 time: 0.270989 Jul 13 02:29:09.358566 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/update_match.py:472: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:09.358566 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = query.session.execute(update_stmt) Jul 13 02:29:09.359220 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 191/376] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:29:09 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 38130 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 13 02:29:09.372053 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:530: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:09.372053 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = model_query(context, models.Service, read_deleted="no").\ Jul 13 02:29:09.403419 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-0de69c62-7e54-493a-b480-08b528fa14dc tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] 10.222.0.32 "DELETE /compute/v2.1/servers/d685507b-3451-47d7-a263-a2ef87d8f116" status: 204 len: 0 microversion: 2.1 time: 0.198692 Jul 13 02:29:09.404014 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 186/377] 10.222.0.32 () {58 vars in 1239 bytes} [Tue Jul 13 02:29:09 2021] DELETE /compute/v2.1/servers/d685507b-3451-47d7-a263-a2ef87d8f116 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 13 02:29:09.412751 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-338ebd60-7af3-4999-aeea-11015b0a2f74 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:09.413461 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-338ebd60-7af3-4999-aeea-11015b0a2f74 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] [instance: d685507b-3451-47d7-a263-a2ef87d8f116] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:09.420186 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-338ebd60-7af3-4999-aeea-11015b0a2f74 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:09.420675 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-338ebd60-7af3-4999-aeea-11015b0a2f74 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:09.421441 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-338ebd60-7af3-4999-aeea-11015b0a2f74 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:09.421880 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-338ebd60-7af3-4999-aeea-11015b0a2f74 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:09.424790 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:09.424790 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:09.447752 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-1186ea53-2354-4b55-bd7c-964fbf4a0016 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:09.448449 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-1186ea53-2354-4b55-bd7c-964fbf4a0016 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: e522ea39-8cb0-4f4f-8346-d951228edeaf] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:09.454179 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-1186ea53-2354-4b55-bd7c-964fbf4a0016 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:09.454627 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-1186ea53-2354-4b55-bd7c-964fbf4a0016 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:09.455387 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-1186ea53-2354-4b55-bd7c-964fbf4a0016 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:09.455822 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-1186ea53-2354-4b55-bd7c-964fbf4a0016 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:09.459369 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:09.459369 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:09.657183 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-338ebd60-7af3-4999-aeea-11015b0a2f74 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177c67d168e5457eb50a960f2bff0838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cde6389460449d8b56f7b5098c7b590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:09.659895 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:09.659895 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:09.667035 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-338ebd60-7af3-4999-aeea-11015b0a2f74 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] 10.222.0.32 "GET /compute/v2.1/servers/d685507b-3451-47d7-a263-a2ef87d8f116" status: 200 len: 1470 microversion: 2.1 time: 0.258607 Jul 13 02:29:09.667614 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 192/378] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:09 2021] GET /compute/v2.1/servers/d685507b-3451-47d7-a263-a2ef87d8f116 => generated 1470 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:09.675563 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-1186ea53-2354-4b55-bd7c-964fbf4a0016 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:09.678817 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:09.678817 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:09.685596 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-1186ea53-2354-4b55-bd7c-964fbf4a0016 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf" status: 200 len: 1317 microversion: 2.1 time: 0.242581 Jul 13 02:29:09.686189 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 187/379] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:09 2021] GET /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:29:09.732181 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-88e6bc47-4421-4e77-b3c6-0a8f80b54990 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:09.732792 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-88e6bc47-4421-4e77-b3c6-0a8f80b54990 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:09.738443 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-88e6bc47-4421-4e77-b3c6-0a8f80b54990 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:09.738894 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-88e6bc47-4421-4e77-b3c6-0a8f80b54990 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:09.740274 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-88e6bc47-4421-4e77-b3c6-0a8f80b54990 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:09.740918 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-88e6bc47-4421-4e77-b3c6-0a8f80b54990 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:09.743975 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:09.743975 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:09.921637 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-88e6bc47-4421-4e77-b3c6-0a8f80b54990 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:09.924420 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:09.924420 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:09.933582 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-88e6bc47-4421-4e77-b3c6-0a8f80b54990 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1724 microversion: 2.1 time: 0.204937 Jul 13 02:29:09.944107 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 193/380] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:09 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:10.015519 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-7e5d4e72-c32d-41c1-9ccd-aad99bfbcee5 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:10.016126 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-7e5d4e72-c32d-41c1-9ccd-aad99bfbcee5 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:10.022837 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7e5d4e72-c32d-41c1-9ccd-aad99bfbcee5 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:10.023306 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7e5d4e72-c32d-41c1-9ccd-aad99bfbcee5 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:10.024067 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7e5d4e72-c32d-41c1-9ccd-aad99bfbcee5 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:10.024493 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7e5d4e72-c32d-41c1-9ccd-aad99bfbcee5 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:10.027392 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:10.027392 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:10.372052 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-f3235a20-0618-4ad9-ade2-e55a784d01b5 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:29:10.373033 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-f3235a20-0618-4ad9-ade2-e55a784d01b5 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:10.379899 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f3235a20-0618-4ad9-ade2-e55a784d01b5 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:10.380405 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f3235a20-0618-4ad9-ade2-e55a784d01b5 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:10.381699 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f3235a20-0618-4ad9-ade2-e55a784d01b5 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:10.382159 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f3235a20-0618-4ad9-ade2-e55a784d01b5 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:10.385103 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:10.385103 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:10.455135 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-7e5d4e72-c32d-41c1-9ccd-aad99bfbcee5 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:10.457772 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:10.457772 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:10.464867 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-7e5d4e72-c32d-41c1-9ccd-aad99bfbcee5 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1520 microversion: 2.1 time: 0.453391 Jul 13 02:29:10.465525 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 188/381] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:10 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1520 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:10.683770 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-42ec3958-973c-4e15-a9f1-3f5359d6fe19 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:10.684366 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-42ec3958-973c-4e15-a9f1-3f5359d6fe19 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] [instance: d685507b-3451-47d7-a263-a2ef87d8f116] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:10.690211 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-42ec3958-973c-4e15-a9f1-3f5359d6fe19 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:10.690652 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-42ec3958-973c-4e15-a9f1-3f5359d6fe19 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:10.691431 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-42ec3958-973c-4e15-a9f1-3f5359d6fe19 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:10.691862 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-42ec3958-973c-4e15-a9f1-3f5359d6fe19 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:10.695177 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:10.695177 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:10.863418 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-42ec3958-973c-4e15-a9f1-3f5359d6fe19 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177c67d168e5457eb50a960f2bff0838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cde6389460449d8b56f7b5098c7b590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:10.866254 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:10.866254 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:10.876065 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-42ec3958-973c-4e15-a9f1-3f5359d6fe19 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] 10.222.0.32 "GET /compute/v2.1/servers/d685507b-3451-47d7-a263-a2ef87d8f116" status: 200 len: 1470 microversion: 2.1 time: 0.196004 Jul 13 02:29:10.876636 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 189/382] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:10 2021] GET /compute/v2.1/servers/d685507b-3451-47d7-a263-a2ef87d8f116 => generated 1470 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:29:10.881670 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-6d7b37a2-f3ed-4717-bd09-a3a31607e964 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:10.882298 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-6d7b37a2-f3ed-4717-bd09-a3a31607e964 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: e522ea39-8cb0-4f4f-8346-d951228edeaf] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:10.888301 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6d7b37a2-f3ed-4717-bd09-a3a31607e964 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:10.888742 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6d7b37a2-f3ed-4717-bd09-a3a31607e964 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:10.889515 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6d7b37a2-f3ed-4717-bd09-a3a31607e964 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:10.889947 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6d7b37a2-f3ed-4717-bd09-a3a31607e964 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:10.892445 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-f3235a20-0618-4ad9-ade2-e55a784d01b5 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 200 len: 38271 microversion: 2.20 time: 0.524158 Jul 13 02:29:10.892857 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:10.892857 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:10.898683 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 194/383] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:29:10 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 38271 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 13 02:29:10.903856 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-08be8364-b213-4ac7-bcb9-e70f673a07d7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:10.904467 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-08be8364-b213-4ac7-bcb9-e70f673a07d7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:10.910984 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-08be8364-b213-4ac7-bcb9-e70f673a07d7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:10.911434 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-08be8364-b213-4ac7-bcb9-e70f673a07d7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:10.912348 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-08be8364-b213-4ac7-bcb9-e70f673a07d7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:10.912786 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-08be8364-b213-4ac7-bcb9-e70f673a07d7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:10.915673 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:10.915673 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:10.974353 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-08be8364-b213-4ac7-bcb9-e70f673a07d7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/ips" status: 200 len: 152 microversion: 2.20 time: 0.074222 Jul 13 02:29:10.980180 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 195/384] 10.222.0.32 () {60 vars in 1289 bytes} [Tue Jul 13 02:29:10 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/ips => generated 152 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:29:10.980180 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-c8601f48-5717-48e5-bd90-0d24d6a63e6f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:10.980180 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-c8601f48-5717-48e5-bd90-0d24d6a63e6f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:10.986341 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c8601f48-5717-48e5-bd90-0d24d6a63e6f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:10.986964 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c8601f48-5717-48e5-bd90-0d24d6a63e6f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:10.987742 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c8601f48-5717-48e5-bd90-0d24d6a63e6f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:10.988181 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c8601f48-5717-48e5-bd90-0d24d6a63e6f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:10.991185 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:10.991185 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:11.120907 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-6d7b37a2-f3ed-4717-bd09-a3a31607e964 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:11.124171 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:11.124171 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:11.133461 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-6d7b37a2-f3ed-4717-bd09-a3a31607e964 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf" status: 200 len: 1317 microversion: 2.1 time: 0.255792 Jul 13 02:29:11.136201 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 190/385] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:10 2021] GET /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf => generated 1317 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:11.201220 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-c8601f48-5717-48e5-bd90-0d24d6a63e6f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:11.204642 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:11.204642 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:11.213649 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-c8601f48-5717-48e5-bd90-0d24d6a63e6f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1724 microversion: 2.1 time: 0.237717 Jul 13 02:29:11.214491 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 196/386] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:10 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1724 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:11.482558 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-c3d5bf31-590f-48fa-a55c-25521a252222 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:11.483190 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-c3d5bf31-590f-48fa-a55c-25521a252222 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:11.489054 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c3d5bf31-590f-48fa-a55c-25521a252222 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:11.489492 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c3d5bf31-590f-48fa-a55c-25521a252222 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:11.491060 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c3d5bf31-590f-48fa-a55c-25521a252222 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:11.491501 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c3d5bf31-590f-48fa-a55c-25521a252222 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:11.494388 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:11.494388 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:11.674808 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-c3d5bf31-590f-48fa-a55c-25521a252222 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:11.678468 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:11.678468 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:11.685284 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-c3d5bf31-590f-48fa-a55c-25521a252222 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1520 microversion: 2.1 time: 0.206831 Jul 13 02:29:11.685883 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 191/387] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:11 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:11.892911 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-717098c4-ab42-43a1-9245-90631f0555cb tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:11.893596 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-717098c4-ab42-43a1-9245-90631f0555cb tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] [instance: d685507b-3451-47d7-a263-a2ef87d8f116] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:11.900667 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-717098c4-ab42-43a1-9245-90631f0555cb tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:11.901126 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-717098c4-ab42-43a1-9245-90631f0555cb tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:11.901890 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-717098c4-ab42-43a1-9245-90631f0555cb tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:11.903025 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-717098c4-ab42-43a1-9245-90631f0555cb tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:11.906151 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:11.906151 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:11.907979 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [req-ad4c1f03-b605-4d81-8cda-c51ab188d1b3 req-47387c07-f132-4f43-bddf-9ad4fcf42c60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e522ea39-8cb0-4f4f-8346-d951228edeaf", "name": "network-vif-plugged", "status": "completed", "tag": "1331fe83-6765-4c69-b422-419458955d3f"}]} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:29:11.909726 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:29:11.909726 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: warnings.warn(msg) Jul 13 02:29:11.917751 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-ad4c1f03-b605-4d81-8cda-c51ab188d1b3 req-47387c07-f132-4f43-bddf-9ad4fcf42c60 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:11.918340 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-ad4c1f03-b605-4d81-8cda-c51ab188d1b3 req-47387c07-f132-4f43-bddf-9ad4fcf42c60 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:11.931301 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.compute.server_external_events [req-ad4c1f03-b605-4d81-8cda-c51ab188d1b3 req-47387c07-f132-4f43-bddf-9ad4fcf42c60 service nova] Creating event network-vif-plugged:1331fe83-6765-4c69-b422-419458955d3f for instance e522ea39-8cb0-4f4f-8346-d951228edeaf on hv-cinder-78102 Jul 13 02:29:11.936462 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [req-ad4c1f03-b605-4d81-8cda-c51ab188d1b3 req-47387c07-f132-4f43-bddf-9ad4fcf42c60 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032340 Jul 13 02:29:11.937667 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 192/388] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:29:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 02:29:12.086113 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-717098c4-ab42-43a1-9245-90631f0555cb tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177c67d168e5457eb50a960f2bff0838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cde6389460449d8b56f7b5098c7b590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:12.088782 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:12.088782 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:12.095943 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-717098c4-ab42-43a1-9245-90631f0555cb tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] 10.222.0.32 "GET /compute/v2.1/servers/d685507b-3451-47d7-a263-a2ef87d8f116" status: 200 len: 1470 microversion: 2.1 time: 0.206862 Jul 13 02:29:12.096520 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 197/389] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:11 2021] GET /compute/v2.1/servers/d685507b-3451-47d7-a263-a2ef87d8f116 => generated 1470 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:12.153290 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-aaf5a172-ef95-416f-848e-da5e896e0ed9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:12.153913 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-aaf5a172-ef95-416f-848e-da5e896e0ed9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: e522ea39-8cb0-4f4f-8346-d951228edeaf] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:12.159759 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-aaf5a172-ef95-416f-848e-da5e896e0ed9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:12.160207 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-aaf5a172-ef95-416f-848e-da5e896e0ed9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:12.160979 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-aaf5a172-ef95-416f-848e-da5e896e0ed9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:12.161407 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-aaf5a172-ef95-416f-848e-da5e896e0ed9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:12.164318 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:12.164318 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:12.231263 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-96f7a2d3-5d84-453d-8bc4-5877ee8e13db tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:12.232033 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-96f7a2d3-5d84-453d-8bc4-5877ee8e13db tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:12.238015 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-96f7a2d3-5d84-453d-8bc4-5877ee8e13db tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:12.238686 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-96f7a2d3-5d84-453d-8bc4-5877ee8e13db tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:12.239598 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-96f7a2d3-5d84-453d-8bc4-5877ee8e13db tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:12.241081 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-96f7a2d3-5d84-453d-8bc4-5877ee8e13db tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:12.244280 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:12.244280 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:12.414452 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-aaf5a172-ef95-416f-848e-da5e896e0ed9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:12.417398 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:12.417398 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:12.439513 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-aaf5a172-ef95-416f-848e-da5e896e0ed9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf" status: 200 len: 1317 microversion: 2.1 time: 0.289973 Jul 13 02:29:12.445100 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 193/390] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:12 2021] GET /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf => generated 1317 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:12.516880 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-96f7a2d3-5d84-453d-8bc4-5877ee8e13db tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:12.519527 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:12.519527 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:12.527618 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-96f7a2d3-5d84-453d-8bc4-5877ee8e13db tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1724 microversion: 2.1 time: 0.300193 Jul 13 02:29:12.528181 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 198/391] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:12 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1724 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:29:12.701736 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-e4b63de2-526a-41b0-8891-28fdbd2a69a3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:12.702448 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-e4b63de2-526a-41b0-8891-28fdbd2a69a3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:12.708812 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e4b63de2-526a-41b0-8891-28fdbd2a69a3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:12.709353 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e4b63de2-526a-41b0-8891-28fdbd2a69a3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:12.710115 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e4b63de2-526a-41b0-8891-28fdbd2a69a3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:12.710556 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e4b63de2-526a-41b0-8891-28fdbd2a69a3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:12.713521 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:12.713521 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:12.890981 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-e4b63de2-526a-41b0-8891-28fdbd2a69a3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:12.893546 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:12.893546 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:12.901826 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-e4b63de2-526a-41b0-8891-28fdbd2a69a3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1500 microversion: 2.1 time: 0.203437 Jul 13 02:29:12.902544 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 194/392] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:12 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1500 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:12.920373 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-51ca076a-bbc0-490f-b830-d6366c49fdee tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f421e773-ced3-4e7f-865a-54f97c9d481b"}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:29:12.923322 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-51ca076a-bbc0-490f-b830-d6366c49fdee tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:12.930256 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-51ca076a-bbc0-490f-b830-d6366c49fdee tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:12.930709 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-51ca076a-bbc0-490f-b830-d6366c49fdee tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:12.931491 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-51ca076a-bbc0-490f-b830-d6366c49fdee tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:12.931926 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-51ca076a-bbc0-490f-b830-d6366c49fdee tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:12.934701 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:12.934701 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:13.001250 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.wsgi [None req-51ca076a-bbc0-490f-b830-d6366c49fdee tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] HTTP exception thrown: Cannot 'attach_volume' instance 163ad440-5d5c-420d-ab44-52f27c5e22dc while it is in vm_state rescued Jul 13 02:29:13.001862 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-51ca076a-bbc0-490f-b830-d6366c49fdee tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Returning 409 to user: Cannot 'attach_volume' instance 163ad440-5d5c-420d-ab44-52f27c5e22dc while it is in vm_state rescued {{(pid=107262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:29:13.002771 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-51ca076a-bbc0-490f-b830-d6366c49fdee tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "POST /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.087895 Jul 13 02:29:13.003564 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 199/393] 10.222.0.32 () {60 vars in 1323 bytes} [Tue Jul 13 02:29:12 2021] POST /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc/os-volume_attachments => generated 152 bytes in 89 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 13 02:29:13.013290 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-4e248ea2-f005-4817-87d7-7fc48cd88249 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:29:13.014178 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-4e248ea2-f005-4817-87d7-7fc48cd88249 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:13.019754 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4e248ea2-f005-4817-87d7-7fc48cd88249 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:13.020443 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4e248ea2-f005-4817-87d7-7fc48cd88249 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:13.021446 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4e248ea2-f005-4817-87d7-7fc48cd88249 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:13.021968 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4e248ea2-f005-4817-87d7-7fc48cd88249 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:13.024984 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:13.024984 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:13.098648 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:13.098648 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:13.112584 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-688a5a15-8993-490f-9dfd-d2653506a3bd tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:13.113384 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-688a5a15-8993-490f-9dfd-d2653506a3bd tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] [instance: d685507b-3451-47d7-a263-a2ef87d8f116] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:13.120010 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-688a5a15-8993-490f-9dfd-d2653506a3bd tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:13.120460 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-688a5a15-8993-490f-9dfd-d2653506a3bd tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:13.121238 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-688a5a15-8993-490f-9dfd-d2653506a3bd tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:13.121671 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-688a5a15-8993-490f-9dfd-d2653506a3bd tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:13.124687 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:13.124687 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:13.169295 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/update_match.py:472: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:13.169295 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = query.session.execute(update_stmt) Jul 13 02:29:13.198171 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-4e248ea2-f005-4817-87d7-7fc48cd88249 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "POST /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc/action" status: 202 len: 0 microversion: 2.1 time: 0.188414 Jul 13 02:29:13.201692 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 195/394] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:29:13 2021] POST /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:29:13.215030 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-f26cecf3-1290-44ed-a7bc-26aada9b2401 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:13.215871 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-f26cecf3-1290-44ed-a7bc-26aada9b2401 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:13.223840 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f26cecf3-1290-44ed-a7bc-26aada9b2401 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:13.226284 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f26cecf3-1290-44ed-a7bc-26aada9b2401 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:13.227479 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f26cecf3-1290-44ed-a7bc-26aada9b2401 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:13.227904 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f26cecf3-1290-44ed-a7bc-26aada9b2401 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:13.231344 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:13.231344 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:13.628704 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-688a5a15-8993-490f-9dfd-d2653506a3bd tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177c67d168e5457eb50a960f2bff0838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cde6389460449d8b56f7b5098c7b590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:13.632420 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:13.632420 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:13.639609 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-688a5a15-8993-490f-9dfd-d2653506a3bd tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] 10.222.0.32 "GET /compute/v2.1/servers/d685507b-3451-47d7-a263-a2ef87d8f116" status: 200 len: 1470 microversion: 2.1 time: 0.530778 Jul 13 02:29:13.640292 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 200/395] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:13 2021] GET /compute/v2.1/servers/d685507b-3451-47d7-a263-a2ef87d8f116 => generated 1470 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:13.644642 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-274c138c-1cf4-4cba-955d-fd9e2a9973f2 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:13.645242 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-274c138c-1cf4-4cba-955d-fd9e2a9973f2 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: e522ea39-8cb0-4f4f-8346-d951228edeaf] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:13.651816 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-274c138c-1cf4-4cba-955d-fd9e2a9973f2 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:13.652251 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-274c138c-1cf4-4cba-955d-fd9e2a9973f2 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:13.653046 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-274c138c-1cf4-4cba-955d-fd9e2a9973f2 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:13.653469 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-274c138c-1cf4-4cba-955d-fd9e2a9973f2 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:13.656357 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:13.656357 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:13.748796 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-f26cecf3-1290-44ed-a7bc-26aada9b2401 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:13.751401 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:13.751401 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:13.758301 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-f26cecf3-1290-44ed-a7bc-26aada9b2401 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1508 microversion: 2.1 time: 0.547527 Jul 13 02:29:13.758873 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 196/396] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:13 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1508 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:13.763517 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-c84cfcda-3475-4ee9-8b80-665b137c2ea0 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:29:13.764049 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-c84cfcda-3475-4ee9-8b80-665b137c2ea0 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:13.769772 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c84cfcda-3475-4ee9-8b80-665b137c2ea0 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:13.770260 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c84cfcda-3475-4ee9-8b80-665b137c2ea0 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:13.771037 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c84cfcda-3475-4ee9-8b80-665b137c2ea0 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:13.771631 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c84cfcda-3475-4ee9-8b80-665b137c2ea0 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:13.774355 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:13.774355 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:13.834370 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.objects.instance [None req-c84cfcda-3475-4ee9-8b80-665b137c2ea0 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lazy-loading 'flavor' on Instance uuid 872b8d83-fdcf-4888-b1d3-64f49541426d {{(pid=107263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 13 02:29:13.854840 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2557: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:13.854840 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: rows_updated = model_query(context, models.InstanceExtra).\ Jul 13 02:29:13.862484 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:13.862484 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:13.923974 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/update_match.py:472: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:13.923974 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = query.session.execute(update_stmt) Jul 13 02:29:13.945293 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3008: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:13.945293 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).\ Jul 13 02:29:14.171875 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-c84cfcda-3475-4ee9-8b80-665b137c2ea0 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 202 len: 0 microversion: 2.20 time: 0.411787 Jul 13 02:29:14.173534 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 197/397] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:29:13 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 13 02:29:14.177755 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-97384503-71ef-4187-a01a-0364faa84db3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:14.178632 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-97384503-71ef-4187-a01a-0364faa84db3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:14.191748 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-97384503-71ef-4187-a01a-0364faa84db3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:14.192186 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-97384503-71ef-4187-a01a-0364faa84db3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:14.193310 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-97384503-71ef-4187-a01a-0364faa84db3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:14.193743 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-97384503-71ef-4187-a01a-0364faa84db3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:14.197305 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:14.197305 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:14.221579 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-274c138c-1cf4-4cba-955d-fd9e2a9973f2 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:14.225097 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:14.225097 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:14.241299 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-274c138c-1cf4-4cba-955d-fd9e2a9973f2 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf" status: 200 len: 1317 microversion: 2.1 time: 0.599892 Jul 13 02:29:14.243583 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 201/398] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:13 2021] GET /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf => generated 1317 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:14.250635 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-b2845048-0737-4f66-8499-e9f3675882d2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:14.251509 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-b2845048-0737-4f66-8499-e9f3675882d2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:14.261737 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b2845048-0737-4f66-8499-e9f3675882d2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:14.262445 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b2845048-0737-4f66-8499-e9f3675882d2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:14.263796 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b2845048-0737-4f66-8499-e9f3675882d2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:14.264410 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b2845048-0737-4f66-8499-e9f3675882d2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:14.267850 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:14.267850 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:14.722073 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-97384503-71ef-4187-a01a-0364faa84db3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:14.725306 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:14.725306 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:14.745721 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-97384503-71ef-4187-a01a-0364faa84db3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1724 microversion: 2.1 time: 0.571969 Jul 13 02:29:14.746352 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 198/399] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:14 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1724 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:14.750930 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [req-8e00c041-d563-4ead-a8ab-b4a9b7ae5889 req-77d38a5d-f0c4-439e-83ac-0049a1538650 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d685507b-3451-47d7-a263-a2ef87d8f116", "name": "network-vif-deleted", "tag": "dc812ec0-21e2-49bb-a037-6c9aadf5274a"}]} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:29:14.752452 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:29:14.752452 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: warnings.warn(msg) Jul 13 02:29:14.761876 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-8e00c041-d563-4ead-a8ab-b4a9b7ae5889 req-77d38a5d-f0c4-439e-83ac-0049a1538650 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:14.762683 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-8e00c041-d563-4ead-a8ab-b4a9b7ae5889 req-77d38a5d-f0c4-439e-83ac-0049a1538650 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:14.776760 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.compute.server_external_events [req-8e00c041-d563-4ead-a8ab-b4a9b7ae5889 req-77d38a5d-f0c4-439e-83ac-0049a1538650 service nova] Creating event network-vif-deleted:dc812ec0-21e2-49bb-a037-6c9aadf5274a for instance d685507b-3451-47d7-a263-a2ef87d8f116 on hv-cinder-78102 Jul 13 02:29:14.779089 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-b2845048-0737-4f66-8499-e9f3675882d2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:14.782092 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [req-8e00c041-d563-4ead-a8ab-b4a9b7ae5889 req-77d38a5d-f0c4-439e-83ac-0049a1538650 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034409 Jul 13 02:29:14.783128 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 199/400] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:29:14 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:29:14.783985 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:14.783985 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:14.796786 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-b2845048-0737-4f66-8499-e9f3675882d2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:14.797243 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-fad57cf6-746b-46bf-a498-70118f3e0239 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:14.798133 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-fad57cf6-746b-46bf-a498-70118f3e0239 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] [instance: d685507b-3451-47d7-a263-a2ef87d8f116] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:14.798938 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-b2845048-0737-4f66-8499-e9f3675882d2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:14.800339 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-b2845048-0737-4f66-8499-e9f3675882d2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1725 microversion: 2.20 time: 0.555285 Jul 13 02:29:14.801035 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 202/401] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:29:14 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1725 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:29:14.805910 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-fad57cf6-746b-46bf-a498-70118f3e0239 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:14.806654 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-fad57cf6-746b-46bf-a498-70118f3e0239 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:14.807636 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-fad57cf6-746b-46bf-a498-70118f3e0239 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:14.808321 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-fad57cf6-746b-46bf-a498-70118f3e0239 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:14.811606 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:14.811606 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:14.817243 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-91de019d-1214-44b6-8f33-f75688a730d4 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:14.817894 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-91de019d-1214-44b6-8f33-f75688a730d4 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:14.825429 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-91de019d-1214-44b6-8f33-f75688a730d4 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:14.825881 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-91de019d-1214-44b6-8f33-f75688a730d4 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:14.826705 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-91de019d-1214-44b6-8f33-f75688a730d4 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:14.827166 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-91de019d-1214-44b6-8f33-f75688a730d4 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:14.830298 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:14.830298 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:14.904040 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-fad57cf6-746b-46bf-a498-70118f3e0239 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:14.904691 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-fad57cf6-746b-46bf-a498-70118f3e0239 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:14.905318 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.objects.instance [None req-fad57cf6-746b-46bf-a498-70118f3e0239 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lazy-loading 'fault' on Instance uuid d685507b-3451-47d7-a263-a2ef87d8f116 {{(pid=107263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 13 02:29:14.908122 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:4002: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:14.908122 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: for row in query: Jul 13 02:29:14.992493 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-fad57cf6-746b-46bf-a498-70118f3e0239 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '177c67d168e5457eb50a960f2bff0838', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cde6389460449d8b56f7b5098c7b590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:14.995063 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:14.995063 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:15.001970 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-fad57cf6-746b-46bf-a498-70118f3e0239 tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] 10.222.0.32 "GET /compute/v2.1/servers/d685507b-3451-47d7-a263-a2ef87d8f116" status: 200 len: 1305 microversion: 2.1 time: 0.217600 Jul 13 02:29:15.006074 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 200/402] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:14 2021] GET /compute/v2.1/servers/d685507b-3451-47d7-a263-a2ef87d8f116 => generated 1305 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:15.069780 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-91de019d-1214-44b6-8f33-f75688a730d4 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:15.072360 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:15.072360 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:15.079205 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-91de019d-1214-44b6-8f33-f75688a730d4 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1508 microversion: 2.1 time: 0.265524 Jul 13 02:29:15.079770 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 203/403] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:14 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1508 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:15.260257 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-e30edd83-4cad-47ab-9496-fe5199f0c24a tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:15.260927 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-e30edd83-4cad-47ab-9496-fe5199f0c24a tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: e522ea39-8cb0-4f4f-8346-d951228edeaf] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:15.266979 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e30edd83-4cad-47ab-9496-fe5199f0c24a tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:15.267426 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e30edd83-4cad-47ab-9496-fe5199f0c24a tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:15.268201 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e30edd83-4cad-47ab-9496-fe5199f0c24a tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:15.268633 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e30edd83-4cad-47ab-9496-fe5199f0c24a tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:15.274461 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:15.274461 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:15.455723 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-e30edd83-4cad-47ab-9496-fe5199f0c24a tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:15.458625 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:15.458625 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:15.465272 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-e30edd83-4cad-47ab-9496-fe5199f0c24a tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf" status: 200 len: 1508 microversion: 2.1 time: 0.208817 Jul 13 02:29:15.465841 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 201/404] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:15 2021] GET /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf => generated 1508 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:15.764763 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-8a223822-ec06-46e9-9cb1-ac91c17ffaf0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:15.767644 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-8a223822-ec06-46e9-9cb1-ac91c17ffaf0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:15.778669 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8a223822-ec06-46e9-9cb1-ac91c17ffaf0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:15.779121 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8a223822-ec06-46e9-9cb1-ac91c17ffaf0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:15.779911 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8a223822-ec06-46e9-9cb1-ac91c17ffaf0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:15.780345 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8a223822-ec06-46e9-9cb1-ac91c17ffaf0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:15.783390 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:15.783390 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:15.820369 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-88a0eb52-beb0-4b58-86db-c6d8435ad0d6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:15.821430 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-88a0eb52-beb0-4b58-86db-c6d8435ad0d6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:15.842054 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-88a0eb52-beb0-4b58-86db-c6d8435ad0d6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:15.842842 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-88a0eb52-beb0-4b58-86db-c6d8435ad0d6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:15.843885 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-88a0eb52-beb0-4b58-86db-c6d8435ad0d6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:15.846547 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-88a0eb52-beb0-4b58-86db-c6d8435ad0d6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:15.862395 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:15.862395 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:16.057848 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-8a223822-ec06-46e9-9cb1-ac91c17ffaf0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:16.060421 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:16.060421 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:16.068038 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-8a223822-ec06-46e9-9cb1-ac91c17ffaf0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1724 microversion: 2.1 time: 0.309492 Jul 13 02:29:16.068990 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 204/405] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:15 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1724 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:16.073606 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-3b8f6fe4-bfdb-4a6e-bba6-63021dd6293e tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:16.074236 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-3b8f6fe4-bfdb-4a6e-bba6-63021dd6293e tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] [instance: d685507b-3451-47d7-a263-a2ef87d8f116] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:16.080063 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3b8f6fe4-bfdb-4a6e-bba6-63021dd6293e tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:16.080511 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3b8f6fe4-bfdb-4a6e-bba6-63021dd6293e tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:16.081307 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3b8f6fe4-bfdb-4a6e-bba6-63021dd6293e tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:16.081737 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3b8f6fe4-bfdb-4a6e-bba6-63021dd6293e tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:16.085204 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:16.085204 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:16.091922 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-88a0eb52-beb0-4b58-86db-c6d8435ad0d6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:16.095073 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:16.095073 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:16.103993 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-88a0eb52-beb0-4b58-86db-c6d8435ad0d6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:16.105707 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-88a0eb52-beb0-4b58-86db-c6d8435ad0d6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:16.107350 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-88a0eb52-beb0-4b58-86db-c6d8435ad0d6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1725 microversion: 2.20 time: 0.291290 Jul 13 02:29:16.107899 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 202/406] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:29:15 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1725 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:29:16.112109 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-8689af7e-c20c-41a3-b268-8164b1d23b20 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:16.112693 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-8689af7e-c20c-41a3-b268-8164b1d23b20 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:16.123343 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8689af7e-c20c-41a3-b268-8164b1d23b20 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:16.123796 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8689af7e-c20c-41a3-b268-8164b1d23b20 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:16.124573 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8689af7e-c20c-41a3-b268-8164b1d23b20 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:16.125000 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8689af7e-c20c-41a3-b268-8164b1d23b20 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:16.127994 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:16.127994 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:16.136119 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.wsgi [None req-3b8f6fe4-bfdb-4a6e-bba6-63021dd6293e tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] HTTP exception thrown: Instance d685507b-3451-47d7-a263-a2ef87d8f116 could not be found. Jul 13 02:29:16.136723 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-3b8f6fe4-bfdb-4a6e-bba6-63021dd6293e tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] Returning 404 to user: Instance d685507b-3451-47d7-a263-a2ef87d8f116 could not be found. {{(pid=107262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:29:16.137558 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-3b8f6fe4-bfdb-4a6e-bba6-63021dd6293e tempest-VolumesNegativeTest-290140316 tempest-VolumesNegativeTest-290140316-project] 10.222.0.32 "GET /compute/v2.1/servers/d685507b-3451-47d7-a263-a2ef87d8f116" status: 404 len: 111 microversion: 2.1 time: 0.067520 Jul 13 02:29:16.138395 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 205/407] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:16 2021] GET /compute/v2.1/servers/d685507b-3451-47d7-a263-a2ef87d8f116 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 02:29:16.312483 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-8689af7e-c20c-41a3-b268-8164b1d23b20 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:16.315053 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:16.315053 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:16.324550 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-8689af7e-c20c-41a3-b268-8164b1d23b20 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1508 microversion: 2.1 time: 0.215635 Jul 13 02:29:16.325434 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 203/408] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:16 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1508 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:16.980718 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-f2f6732d-43de-4492-9031-a7b70a5598ba tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "739be4c7-a2f8-49b9-94df-9915fa5d35b5"}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:29:16.981876 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-f2f6732d-43de-4492-9031-a7b70a5598ba tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: e522ea39-8cb0-4f4f-8346-d951228edeaf] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:16.989697 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f2f6732d-43de-4492-9031-a7b70a5598ba tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:16.990244 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f2f6732d-43de-4492-9031-a7b70a5598ba tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:16.991063 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f2f6732d-43de-4492-9031-a7b70a5598ba tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:16.991531 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f2f6732d-43de-4492-9031-a7b70a5598ba tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:16.994659 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:16.994659 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:17.085221 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-68bd848a-92b5-4ea0-a66f-ccef8c1e3cf8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:17.085940 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-68bd848a-92b5-4ea0-a66f-ccef8c1e3cf8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:17.092048 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-68bd848a-92b5-4ea0-a66f-ccef8c1e3cf8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:17.092571 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-68bd848a-92b5-4ea0-a66f-ccef8c1e3cf8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:17.093386 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-68bd848a-92b5-4ea0-a66f-ccef8c1e3cf8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:17.093823 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-68bd848a-92b5-4ea0-a66f-ccef8c1e3cf8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:17.096782 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:17.096782 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:17.119587 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3019: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:17.119587 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context, Jul 13 02:29:17.215973 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2940: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:17.215973 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: query.update(values) Jul 13 02:29:17.218829 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2941: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:17.218829 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return query.first() Jul 13 02:29:17.335381 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2940: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:17.335381 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: query.update(values) Jul 13 02:29:17.337995 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2941: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:17.337995 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return query.first() Jul 13 02:29:17.360232 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-f2f6732d-43de-4492-9031-a7b70a5598ba tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "POST /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.383397 Jul 13 02:29:17.361072 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 206/409] 10.222.0.32 () {60 vars in 1323 bytes} [Tue Jul 13 02:29:16 2021] POST /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf/os-volume_attachments => generated 194 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:29:17.367644 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-7c68ddae-a5d7-43c6-9dbe-d36d03157a07 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:17.368527 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-7c68ddae-a5d7-43c6-9dbe-d36d03157a07 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:17.376520 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7c68ddae-a5d7-43c6-9dbe-d36d03157a07 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:17.377131 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7c68ddae-a5d7-43c6-9dbe-d36d03157a07 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:17.378052 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7c68ddae-a5d7-43c6-9dbe-d36d03157a07 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:17.378595 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7c68ddae-a5d7-43c6-9dbe-d36d03157a07 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:17.383171 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:17.383171 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:17.553800 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-68bd848a-92b5-4ea0-a66f-ccef8c1e3cf8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:17.556638 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:17.556638 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:17.565123 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-68bd848a-92b5-4ea0-a66f-ccef8c1e3cf8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1724 microversion: 2.1 time: 0.484251 Jul 13 02:29:17.566594 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 204/410] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:17 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1724 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:29:17.571973 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-0ed013ff-12e5-4af9-bc45-f21eb8e68516 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:17.572755 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-0ed013ff-12e5-4af9-bc45-f21eb8e68516 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:17.582158 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0ed013ff-12e5-4af9-bc45-f21eb8e68516 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:17.582825 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0ed013ff-12e5-4af9-bc45-f21eb8e68516 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:17.584497 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0ed013ff-12e5-4af9-bc45-f21eb8e68516 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:17.585068 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0ed013ff-12e5-4af9-bc45-f21eb8e68516 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:17.592506 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:17.592506 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:17.625452 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-7c68ddae-a5d7-43c6-9dbe-d36d03157a07 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:17.628363 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:17.628363 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:17.637184 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-7c68ddae-a5d7-43c6-9dbe-d36d03157a07 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:17.639061 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-7c68ddae-a5d7-43c6-9dbe-d36d03157a07 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:17.640461 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-7c68ddae-a5d7-43c6-9dbe-d36d03157a07 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1725 microversion: 2.20 time: 0.277823 Jul 13 02:29:17.641378 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 207/411] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:29:17 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1725 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:29:17.811434 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-0ed013ff-12e5-4af9-bc45-f21eb8e68516 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:17.813985 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:17.813985 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:17.821604 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-0ed013ff-12e5-4af9-bc45-f21eb8e68516 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1508 microversion: 2.1 time: 0.253866 Jul 13 02:29:17.822213 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 205/412] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:17 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1508 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:18.582732 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-20361b3e-107d-479b-a2c2-bc5e5d21f536 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:18.583902 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-20361b3e-107d-479b-a2c2-bc5e5d21f536 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:18.590328 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-20361b3e-107d-479b-a2c2-bc5e5d21f536 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:18.590775 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-20361b3e-107d-479b-a2c2-bc5e5d21f536 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:18.591550 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-20361b3e-107d-479b-a2c2-bc5e5d21f536 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:18.592039 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-20361b3e-107d-479b-a2c2-bc5e5d21f536 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:18.594991 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:18.594991 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:18.658231 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-a9f9c62d-5e5d-4039-b8c7-55c40a38bff7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:18.658986 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-a9f9c62d-5e5d-4039-b8c7-55c40a38bff7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:18.665615 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a9f9c62d-5e5d-4039-b8c7-55c40a38bff7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:18.666180 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a9f9c62d-5e5d-4039-b8c7-55c40a38bff7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:18.667031 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a9f9c62d-5e5d-4039-b8c7-55c40a38bff7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:18.667537 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a9f9c62d-5e5d-4039-b8c7-55c40a38bff7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:18.670717 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:18.670717 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:18.814915 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-20361b3e-107d-479b-a2c2-bc5e5d21f536 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:18.818239 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:18.818239 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:18.825721 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-20361b3e-107d-479b-a2c2-bc5e5d21f536 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1724 microversion: 2.1 time: 0.246610 Jul 13 02:29:18.826662 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 208/413] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:18 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:18.843165 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-10f2f9ce-6084-4fec-ac11-2287ab4489f3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:18.843866 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-10f2f9ce-6084-4fec-ac11-2287ab4489f3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:18.852045 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-10f2f9ce-6084-4fec-ac11-2287ab4489f3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:18.852713 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-10f2f9ce-6084-4fec-ac11-2287ab4489f3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:18.854130 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-10f2f9ce-6084-4fec-ac11-2287ab4489f3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:18.854579 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-10f2f9ce-6084-4fec-ac11-2287ab4489f3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:18.857747 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:18.857747 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:18.886201 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-a9f9c62d-5e5d-4039-b8c7-55c40a38bff7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:18.889028 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:18.889028 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:18.897001 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-a9f9c62d-5e5d-4039-b8c7-55c40a38bff7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:18.898533 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-a9f9c62d-5e5d-4039-b8c7-55c40a38bff7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:18.899699 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-a9f9c62d-5e5d-4039-b8c7-55c40a38bff7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1725 microversion: 2.20 time: 0.245296 Jul 13 02:29:18.900249 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 206/414] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:29:18 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1725 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:29:19.040115 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-10f2f9ce-6084-4fec-ac11-2287ab4489f3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:19.042690 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:19.042690 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:19.049454 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-10f2f9ce-6084-4fec-ac11-2287ab4489f3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1508 microversion: 2.1 time: 0.214250 Jul 13 02:29:19.050062 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 209/415] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:18 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1508 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:19.843510 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-fd27a9b7-8c08-4d91-8f73-a4b89979078a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:19.844124 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-fd27a9b7-8c08-4d91-8f73-a4b89979078a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:19.851698 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-fd27a9b7-8c08-4d91-8f73-a4b89979078a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:19.852309 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-fd27a9b7-8c08-4d91-8f73-a4b89979078a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:19.853922 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-fd27a9b7-8c08-4d91-8f73-a4b89979078a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:19.854973 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-fd27a9b7-8c08-4d91-8f73-a4b89979078a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:19.858179 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:19.858179 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:19.918106 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-46f3e51b-fc69-497b-b756-d8d13f8808c6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:19.918714 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-46f3e51b-fc69-497b-b756-d8d13f8808c6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:19.924435 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-46f3e51b-fc69-497b-b756-d8d13f8808c6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:19.924880 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-46f3e51b-fc69-497b-b756-d8d13f8808c6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:19.925648 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-46f3e51b-fc69-497b-b756-d8d13f8808c6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:19.926114 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-46f3e51b-fc69-497b-b756-d8d13f8808c6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:19.929807 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:19.929807 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:20.064998 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-fd27a9b7-8c08-4d91-8f73-a4b89979078a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:20.067541 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:20.067541 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:20.074964 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-fd27a9b7-8c08-4d91-8f73-a4b89979078a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1724 microversion: 2.1 time: 0.235303 Jul 13 02:29:20.075546 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 207/416] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:19 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:20.079796 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-799f86d8-1f50-469c-b473-e9b22fb7bb94 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:20.080419 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-799f86d8-1f50-469c-b473-e9b22fb7bb94 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:20.086958 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-799f86d8-1f50-469c-b473-e9b22fb7bb94 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:20.087404 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-799f86d8-1f50-469c-b473-e9b22fb7bb94 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:20.088166 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-799f86d8-1f50-469c-b473-e9b22fb7bb94 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:20.088595 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-799f86d8-1f50-469c-b473-e9b22fb7bb94 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:20.091551 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:20.091551 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:20.131887 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-46f3e51b-fc69-497b-b756-d8d13f8808c6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:20.134450 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:20.134450 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:20.142149 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-46f3e51b-fc69-497b-b756-d8d13f8808c6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:20.143636 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-46f3e51b-fc69-497b-b756-d8d13f8808c6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:20.144807 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-46f3e51b-fc69-497b-b756-d8d13f8808c6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1725 microversion: 2.20 time: 0.230344 Jul 13 02:29:20.145354 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 210/417] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:29:19 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1725 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:29:20.261513 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-799f86d8-1f50-469c-b473-e9b22fb7bb94 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:20.264387 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:20.264387 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:20.271509 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-799f86d8-1f50-469c-b473-e9b22fb7bb94 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1508 microversion: 2.1 time: 0.194647 Jul 13 02:29:20.272071 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 208/418] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:20 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1508 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:21.092073 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-971c5024-0667-4b7a-b6fc-5533a1b767de tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:21.092791 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-971c5024-0667-4b7a-b6fc-5533a1b767de tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:21.099797 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-971c5024-0667-4b7a-b6fc-5533a1b767de tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:21.100330 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-971c5024-0667-4b7a-b6fc-5533a1b767de tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:21.101101 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-971c5024-0667-4b7a-b6fc-5533a1b767de tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:21.101529 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-971c5024-0667-4b7a-b6fc-5533a1b767de tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:21.104443 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:21.104443 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:21.165159 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-d673a690-6755-4a3c-a227-b83a5d3b6221 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:21.166495 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-d673a690-6755-4a3c-a227-b83a5d3b6221 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:21.172789 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d673a690-6755-4a3c-a227-b83a5d3b6221 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:21.173240 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d673a690-6755-4a3c-a227-b83a5d3b6221 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:21.174002 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d673a690-6755-4a3c-a227-b83a5d3b6221 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:21.174458 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d673a690-6755-4a3c-a227-b83a5d3b6221 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:21.177568 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:21.177568 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:21.321862 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-971c5024-0667-4b7a-b6fc-5533a1b767de tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:21.324478 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:21.324478 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:21.332328 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-971c5024-0667-4b7a-b6fc-5533a1b767de tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1724 microversion: 2.1 time: 0.243972 Jul 13 02:29:21.332896 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 211/419] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:21 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1724 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:21.338560 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-625928bd-919c-4d7b-b802-43f890b36be6 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:21.339228 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-625928bd-919c-4d7b-b802-43f890b36be6 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:21.345318 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-625928bd-919c-4d7b-b802-43f890b36be6 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:21.345822 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-625928bd-919c-4d7b-b802-43f890b36be6 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:21.346620 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-625928bd-919c-4d7b-b802-43f890b36be6 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:21.347055 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-625928bd-919c-4d7b-b802-43f890b36be6 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:21.350694 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:21.350694 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:21.394439 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-d673a690-6755-4a3c-a227-b83a5d3b6221 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:21.397412 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:21.397412 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:21.412018 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-d673a690-6755-4a3c-a227-b83a5d3b6221 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:21.413515 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-d673a690-6755-4a3c-a227-b83a5d3b6221 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:21.414682 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-d673a690-6755-4a3c-a227-b83a5d3b6221 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1725 microversion: 2.20 time: 0.254326 Jul 13 02:29:21.415230 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 209/420] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:29:21 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1725 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:29:21.522876 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-625928bd-919c-4d7b-b802-43f890b36be6 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:21.525403 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:21.525403 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:21.532165 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-625928bd-919c-4d7b-b802-43f890b36be6 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1514 microversion: 2.1 time: 0.197669 Jul 13 02:29:21.532722 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 212/421] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:21 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1514 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:22.349838 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-8103ce5f-c01d-4419-93a3-78d70e7b8267 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:22.350692 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-8103ce5f-c01d-4419-93a3-78d70e7b8267 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:22.356459 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8103ce5f-c01d-4419-93a3-78d70e7b8267 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:22.356897 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8103ce5f-c01d-4419-93a3-78d70e7b8267 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:22.357665 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8103ce5f-c01d-4419-93a3-78d70e7b8267 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:22.358103 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8103ce5f-c01d-4419-93a3-78d70e7b8267 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:22.361283 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:22.361283 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:22.432763 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-7f1ee071-eb40-4162-b205-1204b5ed53a5 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:22.433371 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-7f1ee071-eb40-4162-b205-1204b5ed53a5 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:22.439195 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7f1ee071-eb40-4162-b205-1204b5ed53a5 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:22.439846 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7f1ee071-eb40-4162-b205-1204b5ed53a5 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:22.440618 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7f1ee071-eb40-4162-b205-1204b5ed53a5 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:22.441047 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7f1ee071-eb40-4162-b205-1204b5ed53a5 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:22.444180 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:22.444180 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:22.569384 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-8103ce5f-c01d-4419-93a3-78d70e7b8267 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:22.572143 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:22.572143 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:22.579660 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-8103ce5f-c01d-4419-93a3-78d70e7b8267 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1724 microversion: 2.1 time: 0.234245 Jul 13 02:29:22.589541 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 210/422] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:22 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:22.632615 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-7f1ee071-eb40-4162-b205-1204b5ed53a5 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:22.635177 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:22.635177 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:22.642559 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-7f1ee071-eb40-4162-b205-1204b5ed53a5 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:22.644082 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-7f1ee071-eb40-4162-b205-1204b5ed53a5 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:22.645205 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-7f1ee071-eb40-4162-b205-1204b5ed53a5 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1725 microversion: 2.20 time: 0.216177 Jul 13 02:29:22.646420 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 213/423] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:29:22 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1725 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:29:23.597042 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-3faebb63-4638-42ab-9789-22bd8c66341f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:23.597576 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-3faebb63-4638-42ab-9789-22bd8c66341f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:23.604034 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-3faebb63-4638-42ab-9789-22bd8c66341f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:23.604483 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-3faebb63-4638-42ab-9789-22bd8c66341f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:23.605249 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-3faebb63-4638-42ab-9789-22bd8c66341f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:23.605683 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-3faebb63-4638-42ab-9789-22bd8c66341f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:23.608544 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:23.608544 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:23.664167 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-e35af4e2-2817-4ccf-81f6-856f9421db25 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:23.664764 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-e35af4e2-2817-4ccf-81f6-856f9421db25 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:23.670471 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e35af4e2-2817-4ccf-81f6-856f9421db25 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:23.670908 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e35af4e2-2817-4ccf-81f6-856f9421db25 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:23.671695 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e35af4e2-2817-4ccf-81f6-856f9421db25 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:23.672122 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e35af4e2-2817-4ccf-81f6-856f9421db25 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:23.675038 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:23.675038 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:23.816095 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-3faebb63-4638-42ab-9789-22bd8c66341f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:23.818685 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:23.818685 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:23.825990 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-3faebb63-4638-42ab-9789-22bd8c66341f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1724 microversion: 2.1 time: 0.232737 Jul 13 02:29:23.826596 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 211/424] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:23 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:23.879063 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-e35af4e2-2817-4ccf-81f6-856f9421db25 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:23.881677 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:23.881677 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:23.889380 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-e35af4e2-2817-4ccf-81f6-856f9421db25 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:23.890898 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-e35af4e2-2817-4ccf-81f6-856f9421db25 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:23.892039 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-e35af4e2-2817-4ccf-81f6-856f9421db25 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1725 microversion: 2.20 time: 0.232148 Jul 13 02:29:23.892595 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 214/425] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:29:23 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1725 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:29:24.843395 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-09d91608-ebb1-4917-8b4e-24e8b72daf58 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:24.844009 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-09d91608-ebb1-4917-8b4e-24e8b72daf58 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:24.852452 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-09d91608-ebb1-4917-8b4e-24e8b72daf58 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:24.852904 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-09d91608-ebb1-4917-8b4e-24e8b72daf58 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:24.853804 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-09d91608-ebb1-4917-8b4e-24e8b72daf58 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:24.854352 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-09d91608-ebb1-4917-8b4e-24e8b72daf58 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:24.857632 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:24.857632 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:24.911271 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-a9751ceb-9329-4573-9787-d543757008d0 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:24.912592 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-a9751ceb-9329-4573-9787-d543757008d0 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:24.924822 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a9751ceb-9329-4573-9787-d543757008d0 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:24.925273 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a9751ceb-9329-4573-9787-d543757008d0 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:24.926103 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a9751ceb-9329-4573-9787-d543757008d0 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:24.926532 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a9751ceb-9329-4573-9787-d543757008d0 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:24.929751 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:24.929751 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:25.089334 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-09d91608-ebb1-4917-8b4e-24e8b72daf58 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:25.093767 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:25.093767 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:25.101309 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-09d91608-ebb1-4917-8b4e-24e8b72daf58 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1724 microversion: 2.1 time: 0.261512 Jul 13 02:29:25.110115 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 212/426] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:24 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1724 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:25.156924 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-a9751ceb-9329-4573-9787-d543757008d0 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:25.159910 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:25.159910 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:25.168047 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-a9751ceb-9329-4573-9787-d543757008d0 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:25.169662 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-a9751ceb-9329-4573-9787-d543757008d0 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:25.170905 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-a9751ceb-9329-4573-9787-d543757008d0 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1725 microversion: 2.20 time: 0.263452 Jul 13 02:29:25.171539 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 215/427] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:29:24 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1725 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:29:26.118367 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-e6fa8fbe-c3e7-4a4b-8fe3-41c0e88ac4a7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:26.118985 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-e6fa8fbe-c3e7-4a4b-8fe3-41c0e88ac4a7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:26.124861 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e6fa8fbe-c3e7-4a4b-8fe3-41c0e88ac4a7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:26.125309 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e6fa8fbe-c3e7-4a4b-8fe3-41c0e88ac4a7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:26.126096 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e6fa8fbe-c3e7-4a4b-8fe3-41c0e88ac4a7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:26.126536 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e6fa8fbe-c3e7-4a4b-8fe3-41c0e88ac4a7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:26.129345 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:26.129345 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:26.195530 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-2b30554e-3b78-4e64-87b4-85a959e09683 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:26.195530 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-2b30554e-3b78-4e64-87b4-85a959e09683 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:26.195530 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2b30554e-3b78-4e64-87b4-85a959e09683 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:26.196139 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2b30554e-3b78-4e64-87b4-85a959e09683 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:26.196432 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2b30554e-3b78-4e64-87b4-85a959e09683 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:26.196866 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2b30554e-3b78-4e64-87b4-85a959e09683 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:26.199876 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:26.199876 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:26.340133 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-e6fa8fbe-c3e7-4a4b-8fe3-41c0e88ac4a7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:26.342801 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:26.342801 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:26.350790 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-e6fa8fbe-c3e7-4a4b-8fe3-41c0e88ac4a7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1724 microversion: 2.1 time: 0.236207 Jul 13 02:29:26.351473 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 213/428] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:26 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1724 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:26.402739 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-2b30554e-3b78-4e64-87b4-85a959e09683 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:26.405601 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:26.405601 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:26.413910 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-2b30554e-3b78-4e64-87b4-85a959e09683 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:26.415451 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-2b30554e-3b78-4e64-87b4-85a959e09683 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:26.416592 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-2b30554e-3b78-4e64-87b4-85a959e09683 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1725 microversion: 2.20 time: 0.231650 Jul 13 02:29:26.417142 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 216/429] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:29:26 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1725 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:29:27.368570 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-58c7a9c1-76e2-4b9b-81dd-2cee8b5e2b5c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:27.369122 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-58c7a9c1-76e2-4b9b-81dd-2cee8b5e2b5c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:27.374891 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-58c7a9c1-76e2-4b9b-81dd-2cee8b5e2b5c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:27.375333 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-58c7a9c1-76e2-4b9b-81dd-2cee8b5e2b5c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:27.376081 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-58c7a9c1-76e2-4b9b-81dd-2cee8b5e2b5c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:27.376506 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-58c7a9c1-76e2-4b9b-81dd-2cee8b5e2b5c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:27.379331 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:27.379331 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:27.435016 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-b402dfc3-f3bb-46e7-9cde-244b4a5420ff tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:27.435711 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-b402dfc3-f3bb-46e7-9cde-244b4a5420ff tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:27.441445 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b402dfc3-f3bb-46e7-9cde-244b4a5420ff tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:27.441876 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b402dfc3-f3bb-46e7-9cde-244b4a5420ff tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:27.443168 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b402dfc3-f3bb-46e7-9cde-244b4a5420ff tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:27.443742 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b402dfc3-f3bb-46e7-9cde-244b4a5420ff tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:27.446618 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:27.446618 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:27.582005 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-58c7a9c1-76e2-4b9b-81dd-2cee8b5e2b5c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:27.585426 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:27.585426 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:27.592896 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-58c7a9c1-76e2-4b9b-81dd-2cee8b5e2b5c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1724 microversion: 2.1 time: 0.229168 Jul 13 02:29:27.593648 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 214/430] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:27 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:27.644928 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-b402dfc3-f3bb-46e7-9cde-244b4a5420ff tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:27.647513 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:27.647513 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:27.655737 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-b402dfc3-f3bb-46e7-9cde-244b4a5420ff tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:27.657097 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-b402dfc3-f3bb-46e7-9cde-244b4a5420ff tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:27.658264 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-b402dfc3-f3bb-46e7-9cde-244b4a5420ff tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1725 microversion: 2.20 time: 0.226879 Jul 13 02:29:27.658804 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 217/431] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:29:27 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1725 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:29:28.609689 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-aeea831c-7acc-4dbf-a44d-b4dd4bc704b3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:28.610373 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-aeea831c-7acc-4dbf-a44d-b4dd4bc704b3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:28.616242 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-aeea831c-7acc-4dbf-a44d-b4dd4bc704b3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:28.616688 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-aeea831c-7acc-4dbf-a44d-b4dd4bc704b3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:28.617448 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-aeea831c-7acc-4dbf-a44d-b4dd4bc704b3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:28.617878 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-aeea831c-7acc-4dbf-a44d-b4dd4bc704b3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:28.620699 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:28.620699 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:28.676132 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-ff237aa0-dce9-4d58-9f01-e791a78ef6a7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:28.676738 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-ff237aa0-dce9-4d58-9f01-e791a78ef6a7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:28.682948 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ff237aa0-dce9-4d58-9f01-e791a78ef6a7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:28.683395 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ff237aa0-dce9-4d58-9f01-e791a78ef6a7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:28.684164 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ff237aa0-dce9-4d58-9f01-e791a78ef6a7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:28.684877 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ff237aa0-dce9-4d58-9f01-e791a78ef6a7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:28.687805 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:28.687805 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:28.838256 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-aeea831c-7acc-4dbf-a44d-b4dd4bc704b3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:28.841052 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:28.841052 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:28.848487 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-aeea831c-7acc-4dbf-a44d-b4dd4bc704b3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1724 microversion: 2.1 time: 0.242429 Jul 13 02:29:28.849713 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 215/432] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:28 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1724 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:28.903806 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-ff237aa0-dce9-4d58-9f01-e791a78ef6a7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:28.906496 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:28.906496 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:28.914463 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-ff237aa0-dce9-4d58-9f01-e791a78ef6a7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:28.915954 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-ff237aa0-dce9-4d58-9f01-e791a78ef6a7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:28.917118 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-ff237aa0-dce9-4d58-9f01-e791a78ef6a7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1725 microversion: 2.20 time: 0.244740 Jul 13 02:29:28.917671 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 218/433] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:29:28 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1725 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:29:29.237281 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-6551fa97-fca8-4989-8625-33ed551c57e3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:29.237919 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-6551fa97-fca8-4989-8625-33ed551c57e3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:29.244473 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6551fa97-fca8-4989-8625-33ed551c57e3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:29.244928 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6551fa97-fca8-4989-8625-33ed551c57e3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:29.245709 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6551fa97-fca8-4989-8625-33ed551c57e3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:29.246180 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6551fa97-fca8-4989-8625-33ed551c57e3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:29.249309 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:29.249309 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:29.431956 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-6551fa97-fca8-4989-8625-33ed551c57e3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:29.434542 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:29.434542 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:29.441792 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-6551fa97-fca8-4989-8625-33ed551c57e3 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1514 microversion: 2.1 time: 0.208148 Jul 13 02:29:29.442395 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 216/434] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:29 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1514 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:29.458304 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-5637a6b7-9cbc-45ed-8332-7275346a5f8b tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e3226124-85f2-46fa-ac19-c03530db7a21"}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:29:29.459593 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-5637a6b7-9cbc-45ed-8332-7275346a5f8b tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:29.465345 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5637a6b7-9cbc-45ed-8332-7275346a5f8b tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:29.465816 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5637a6b7-9cbc-45ed-8332-7275346a5f8b tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:29.466717 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5637a6b7-9cbc-45ed-8332-7275346a5f8b tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:29.467148 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5637a6b7-9cbc-45ed-8332-7275346a5f8b tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:29.469902 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:29.469902 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:29.588265 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3019: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:29.588265 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context, Jul 13 02:29:29.866730 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-e6175656-bcf4-4194-8bd5-d14460c7c2bf tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:29.867440 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-e6175656-bcf4-4194-8bd5-d14460c7c2bf tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:29.873902 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e6175656-bcf4-4194-8bd5-d14460c7c2bf tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:29.874394 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e6175656-bcf4-4194-8bd5-d14460c7c2bf tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:29.875274 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e6175656-bcf4-4194-8bd5-d14460c7c2bf tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:29.875754 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e6175656-bcf4-4194-8bd5-d14460c7c2bf tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:29.879089 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:29.879089 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:30.098102 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-e6175656-bcf4-4194-8bd5-d14460c7c2bf tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:30.101067 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:30.101067 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:30.109692 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-e6175656-bcf4-4194-8bd5-d14460c7c2bf tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1724 microversion: 2.1 time: 0.247039 Jul 13 02:29:30.110401 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 217/435] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:29 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:29:30.116348 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-59481ede-fe37-4cc3-8c2c-427970c11d9b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:30.116958 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-59481ede-fe37-4cc3-8c2c-427970c11d9b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:30.124314 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-59481ede-fe37-4cc3-8c2c-427970c11d9b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:30.124901 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-59481ede-fe37-4cc3-8c2c-427970c11d9b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:30.125689 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-59481ede-fe37-4cc3-8c2c-427970c11d9b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:30.126145 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-59481ede-fe37-4cc3-8c2c-427970c11d9b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:30.129618 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:30.129618 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:30.305384 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-59481ede-fe37-4cc3-8c2c-427970c11d9b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:30.307969 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:30.307969 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:30.315243 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-59481ede-fe37-4cc3-8c2c-427970c11d9b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:30.316724 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-59481ede-fe37-4cc3-8c2c-427970c11d9b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:30.317889 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-59481ede-fe37-4cc3-8c2c-427970c11d9b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1725 microversion: 2.20 time: 0.206521 Jul 13 02:29:30.318474 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 218/436] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:29:30 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1725 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:29:31.128515 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-9e131408-d2af-421c-a212-f1d1fee5c939 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:31.129113 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-9e131408-d2af-421c-a212-f1d1fee5c939 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:31.135606 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-9e131408-d2af-421c-a212-f1d1fee5c939 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:31.136069 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-9e131408-d2af-421c-a212-f1d1fee5c939 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:31.136827 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-9e131408-d2af-421c-a212-f1d1fee5c939 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:31.137254 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-9e131408-d2af-421c-a212-f1d1fee5c939 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:31.140393 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:31.140393 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:31.316754 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-9e131408-d2af-421c-a212-f1d1fee5c939 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:31.320526 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:31.320526 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:31.327810 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-9e131408-d2af-421c-a212-f1d1fee5c939 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1724 microversion: 2.1 time: 0.203026 Jul 13 02:29:31.328366 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 219/437] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:31 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:29:31.335985 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-4968cc16-2f95-4c7b-abfd-c663c281dbe7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:31.336587 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-4968cc16-2f95-4c7b-abfd-c663c281dbe7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:31.342185 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4968cc16-2f95-4c7b-abfd-c663c281dbe7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:31.342636 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4968cc16-2f95-4c7b-abfd-c663c281dbe7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:31.343402 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4968cc16-2f95-4c7b-abfd-c663c281dbe7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:31.343835 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4968cc16-2f95-4c7b-abfd-c663c281dbe7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:31.346663 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:31.346663 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:31.516440 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-4968cc16-2f95-4c7b-abfd-c663c281dbe7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:31.519069 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:31.519069 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:31.526535 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-4968cc16-2f95-4c7b-abfd-c663c281dbe7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:31.528038 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-4968cc16-2f95-4c7b-abfd-c663c281dbe7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:31.529174 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-4968cc16-2f95-4c7b-abfd-c663c281dbe7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1725 microversion: 2.20 time: 0.197170 Jul 13 02:29:31.529734 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 220/438] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:29:31 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1725 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:29:31.874907 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2940: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:31.874907 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: query.update(values) Jul 13 02:29:31.877179 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2941: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:31.877179 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return query.first() Jul 13 02:29:31.963955 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2940: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:31.963955 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: query.update(values) Jul 13 02:29:31.966135 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2941: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:31.966135 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return query.first() Jul 13 02:29:31.986398 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-5637a6b7-9cbc-45ed-8332-7275346a5f8b tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "POST /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.531651 Jul 13 02:29:31.987012 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 219/439] 10.222.0.32 () {60 vars in 1323 bytes} [Tue Jul 13 02:29:29 2021] POST /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc/os-volume_attachments => generated 194 bytes in 2533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:29:32.344767 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-36d4438e-0992-4d99-8693-c8f92ae15366 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:32.345469 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-36d4438e-0992-4d99-8693-c8f92ae15366 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:32.352016 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-36d4438e-0992-4d99-8693-c8f92ae15366 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:32.352456 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-36d4438e-0992-4d99-8693-c8f92ae15366 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:32.353223 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-36d4438e-0992-4d99-8693-c8f92ae15366 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:32.353664 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-36d4438e-0992-4d99-8693-c8f92ae15366 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:32.362395 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:32.362395 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:32.536318 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-36d4438e-0992-4d99-8693-c8f92ae15366 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:32.538993 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:32.538993 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:32.546893 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-36d4438e-0992-4d99-8693-c8f92ae15366 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1701 microversion: 2.1 time: 0.205590 Jul 13 02:29:32.547348 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 221/440] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:32 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1701 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:32.548475 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-f9ab0aaf-1fce-498a-b234-3d8b221e4cc1 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:32.549419 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-f9ab0aaf-1fce-498a-b234-3d8b221e4cc1 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:32.556083 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f9ab0aaf-1fce-498a-b234-3d8b221e4cc1 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:32.556523 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f9ab0aaf-1fce-498a-b234-3d8b221e4cc1 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:32.557286 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f9ab0aaf-1fce-498a-b234-3d8b221e4cc1 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:32.557711 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f9ab0aaf-1fce-498a-b234-3d8b221e4cc1 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:32.561734 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:32.561734 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:32.565990 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-380fa1ad-5ca0-4d7b-9efe-6591ce19adda tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:29:32.574842 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-380fa1ad-5ca0-4d7b-9efe-6591ce19adda tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:32.575452 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-380fa1ad-5ca0-4d7b-9efe-6591ce19adda tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:32.578098 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:32.578098 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:32.644720 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-380fa1ad-5ca0-4d7b-9efe-6591ce19adda tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Going to try to start instance {{(pid=107263) start /opt/stack/nova/nova/compute/api.py:2605}} Jul 13 02:29:32.650836 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:32.650836 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:32.718155 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/update_match.py:472: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:32.718155 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = query.session.execute(update_stmt) Jul 13 02:29:32.745335 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-380fa1ad-5ca0-4d7b-9efe-6591ce19adda tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 202 len: 0 microversion: 2.1 time: 0.185364 Jul 13 02:29:32.746085 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 222/441] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:29:32 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 13 02:29:32.754067 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-3c0700e0-5f48-4d9b-b2c9-0531c81cfe87 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:32.754855 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-3c0700e0-5f48-4d9b-b2c9-0531c81cfe87 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:32.762266 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-3c0700e0-5f48-4d9b-b2c9-0531c81cfe87 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:32.763370 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-3c0700e0-5f48-4d9b-b2c9-0531c81cfe87 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:32.764192 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-f9ab0aaf-1fce-498a-b234-3d8b221e4cc1 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:32.764533 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-3c0700e0-5f48-4d9b-b2c9-0531c81cfe87 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:32.765005 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-3c0700e0-5f48-4d9b-b2c9-0531c81cfe87 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:32.767469 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:32.767469 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:32.768563 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:32.768563 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:32.777016 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-f9ab0aaf-1fce-498a-b234-3d8b221e4cc1 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:32.778543 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-f9ab0aaf-1fce-498a-b234-3d8b221e4cc1 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:32.779686 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-f9ab0aaf-1fce-498a-b234-3d8b221e4cc1 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1725 microversion: 2.20 time: 0.236010 Jul 13 02:29:32.780362 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 220/442] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:29:32 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1725 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:29:32.989696 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-3c0700e0-5f48-4d9b-b2c9-0531c81cfe87 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:32.992947 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:32.992947 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:33.000305 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-3c0700e0-5f48-4d9b-b2c9-0531c81cfe87 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1710 microversion: 2.1 time: 0.250098 Jul 13 02:29:33.001150 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 223/443] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:32 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1710 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:29:33.797609 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-64114847-d298-4a4c-bd89-c95d34f07a28 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:33.798512 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-64114847-d298-4a4c-bd89-c95d34f07a28 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:33.805724 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-64114847-d298-4a4c-bd89-c95d34f07a28 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:33.806325 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-64114847-d298-4a4c-bd89-c95d34f07a28 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:33.807374 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-64114847-d298-4a4c-bd89-c95d34f07a28 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:33.807921 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-64114847-d298-4a4c-bd89-c95d34f07a28 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:33.811023 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:33.811023 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:33.996834 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-64114847-d298-4a4c-bd89-c95d34f07a28 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:33.999426 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:33.999426 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:34.012039 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-64114847-d298-4a4c-bd89-c95d34f07a28 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:34.012039 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-64114847-d298-4a4c-bd89-c95d34f07a28 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:34.012039 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-64114847-d298-4a4c-bd89-c95d34f07a28 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1725 microversion: 2.20 time: 0.216504 Jul 13 02:29:34.012447 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 221/444] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:29:33 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1725 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:29:34.019821 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-63098785-99f6-42ea-85b8-1a8c1be47d69 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:34.020511 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-63098785-99f6-42ea-85b8-1a8c1be47d69 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:34.027673 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-63098785-99f6-42ea-85b8-1a8c1be47d69 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:34.028176 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-63098785-99f6-42ea-85b8-1a8c1be47d69 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:34.029033 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-63098785-99f6-42ea-85b8-1a8c1be47d69 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:34.029396 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-63098785-99f6-42ea-85b8-1a8c1be47d69 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:34.032368 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:34.032368 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:34.224105 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-63098785-99f6-42ea-85b8-1a8c1be47d69 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:34.227488 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:34.227488 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:34.235225 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-63098785-99f6-42ea-85b8-1a8c1be47d69 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1710 microversion: 2.1 time: 0.220109 Jul 13 02:29:34.235877 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 224/445] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:34 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1710 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:35.027782 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-41e6fcf5-9e3b-4aa4-9131-657144edc933 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:35.028393 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-41e6fcf5-9e3b-4aa4-9131-657144edc933 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:35.034230 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-41e6fcf5-9e3b-4aa4-9131-657144edc933 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:35.034678 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-41e6fcf5-9e3b-4aa4-9131-657144edc933 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:35.035441 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-41e6fcf5-9e3b-4aa4-9131-657144edc933 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:35.035877 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-41e6fcf5-9e3b-4aa4-9131-657144edc933 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:35.038849 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:35.038849 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:35.253310 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-31080802-c1a1-440e-83c9-cad072e86042 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:35.254351 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-31080802-c1a1-440e-83c9-cad072e86042 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:35.261419 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-31080802-c1a1-440e-83c9-cad072e86042 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:35.261959 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-31080802-c1a1-440e-83c9-cad072e86042 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:35.263092 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-31080802-c1a1-440e-83c9-cad072e86042 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:35.263942 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-31080802-c1a1-440e-83c9-cad072e86042 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:35.267252 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:35.267252 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:35.393110 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-41e6fcf5-9e3b-4aa4-9131-657144edc933 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:35.395652 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:35.395652 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:35.403571 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-41e6fcf5-9e3b-4aa4-9131-657144edc933 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:35.405040 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-41e6fcf5-9e3b-4aa4-9131-657144edc933 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:35.406197 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-41e6fcf5-9e3b-4aa4-9131-657144edc933 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1725 microversion: 2.20 time: 0.382149 Jul 13 02:29:35.407126 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 222/446] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:29:35 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1725 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:29:35.464179 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-31080802-c1a1-440e-83c9-cad072e86042 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:35.466806 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:35.466806 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:35.474147 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-31080802-c1a1-440e-83c9-cad072e86042 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1714 microversion: 2.1 time: 0.225349 Jul 13 02:29:35.474708 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 225/447] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:35 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1714 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:35.998300 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-b98ac8b0-98bf-4749-be32-6d8de3c2317f tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:35.998782 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-b98ac8b0-98bf-4749-be32-6d8de3c2317f tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 97a3e7df-5271-4585-b962-e014adc2c87b] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:36.004978 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b98ac8b0-98bf-4749-be32-6d8de3c2317f tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:36.005423 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b98ac8b0-98bf-4749-be32-6d8de3c2317f tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:36.006216 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b98ac8b0-98bf-4749-be32-6d8de3c2317f tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:36.006642 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b98ac8b0-98bf-4749-be32-6d8de3c2317f tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:36.009585 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:36.009585 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:36.126580 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3031: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:36.126580 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context, Jul 13 02:29:36.133217 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.objects.instance [None req-b98ac8b0-98bf-4749-be32-6d8de3c2317f tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lazy-loading 'services' on Instance uuid 97a3e7df-5271-4585-b962-e014adc2c87b {{(pid=107262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 13 02:29:36.242750 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-b98ac8b0-98bf-4749-be32-6d8de3c2317f tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "DELETE /compute/v2.1/servers/97a3e7df-5271-4585-b962-e014adc2c87b/os-volume_attachments/764bd671-ce1c-4114-84f7-f9f49ae0bc7b" status: 202 len: 0 microversion: 2.1 time: 0.247804 Jul 13 02:29:36.243571 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 223/448] 10.222.0.32 () {58 vars in 1416 bytes} [Tue Jul 13 02:29:35 2021] DELETE /compute/v2.1/servers/97a3e7df-5271-4585-b962-e014adc2c87b/os-volume_attachments/764bd671-ce1c-4114-84f7-f9f49ae0bc7b => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:29:36.425730 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-24ca70a1-a292-47eb-a2c8-e6ce2395b072 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:36.426391 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-24ca70a1-a292-47eb-a2c8-e6ce2395b072 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:36.432107 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-24ca70a1-a292-47eb-a2c8-e6ce2395b072 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:36.432558 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-24ca70a1-a292-47eb-a2c8-e6ce2395b072 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:36.433318 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-24ca70a1-a292-47eb-a2c8-e6ce2395b072 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:36.433747 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-24ca70a1-a292-47eb-a2c8-e6ce2395b072 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:36.436587 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:36.436587 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:36.610648 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-24ca70a1-a292-47eb-a2c8-e6ce2395b072 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:36.613183 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:36.613183 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:36.620865 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-24ca70a1-a292-47eb-a2c8-e6ce2395b072 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:36.622407 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-24ca70a1-a292-47eb-a2c8-e6ce2395b072 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:36.623535 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-24ca70a1-a292-47eb-a2c8-e6ce2395b072 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1746 microversion: 2.20 time: 0.201606 Jul 13 02:29:36.624084 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 226/449] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:29:36 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1746 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:29:37.652106 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-4adfa9d0-97e1-49fd-b44e-56af1ec6ef39 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:37.652106 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-4adfa9d0-97e1-49fd-b44e-56af1ec6ef39 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:37.652672 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-4adfa9d0-97e1-49fd-b44e-56af1ec6ef39 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:37.653023 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-4adfa9d0-97e1-49fd-b44e-56af1ec6ef39 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:37.653834 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-4adfa9d0-97e1-49fd-b44e-56af1ec6ef39 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:37.654298 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-4adfa9d0-97e1-49fd-b44e-56af1ec6ef39 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:37.658089 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:37.658089 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:37.840790 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-4adfa9d0-97e1-49fd-b44e-56af1ec6ef39 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:37.843415 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:37.843415 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:37.850982 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-4adfa9d0-97e1-49fd-b44e-56af1ec6ef39 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:37.852530 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-4adfa9d0-97e1-49fd-b44e-56af1ec6ef39 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:37.853720 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-4adfa9d0-97e1-49fd-b44e-56af1ec6ef39 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1746 microversion: 2.20 time: 0.214593 Jul 13 02:29:37.854302 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 224/450] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:29:37 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1746 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:29:38.871853 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-3a674b7b-b4d2-4fce-9502-bff1bb385d08 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:38.872453 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-3a674b7b-b4d2-4fce-9502-bff1bb385d08 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:38.879942 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-3a674b7b-b4d2-4fce-9502-bff1bb385d08 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:38.880582 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-3a674b7b-b4d2-4fce-9502-bff1bb385d08 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:38.881680 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-3a674b7b-b4d2-4fce-9502-bff1bb385d08 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:38.882382 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-3a674b7b-b4d2-4fce-9502-bff1bb385d08 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:38.885423 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:38.885423 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:38.967079 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-77841657-9b5d-4c6d-ad5c-70deda49b785 req-bc61b3d7-704d-49d6-8fdc-faf829604bb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "872b8d83-fdcf-4888-b1d3-64f49541426d", "name": "network-vif-plugged", "status": "completed", "tag": "49588aa8-e16a-42d4-9d7e-8c1cf67a6211"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:29:38.969365 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:29:38.969365 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:29:38.977035 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-77841657-9b5d-4c6d-ad5c-70deda49b785 req-bc61b3d7-704d-49d6-8fdc-faf829604bb4 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:38.977487 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-77841657-9b5d-4c6d-ad5c-70deda49b785 req-bc61b3d7-704d-49d6-8fdc-faf829604bb4 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:38.998534 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-77841657-9b5d-4c6d-ad5c-70deda49b785 req-bc61b3d7-704d-49d6-8fdc-faf829604bb4 service nova] Creating event network-vif-plugged:49588aa8-e16a-42d4-9d7e-8c1cf67a6211 for instance 872b8d83-fdcf-4888-b1d3-64f49541426d on hv-cinder-78102 Jul 13 02:29:39.004022 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-77841657-9b5d-4c6d-ad5c-70deda49b785 req-bc61b3d7-704d-49d6-8fdc-faf829604bb4 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040533 Jul 13 02:29:39.005290 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 225/451] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:29:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 02:29:39.176085 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-3a674b7b-b4d2-4fce-9502-bff1bb385d08 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:39.179221 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:39.179221 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:39.188266 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-3a674b7b-b4d2-4fce-9502-bff1bb385d08 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:39.190298 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-3a674b7b-b4d2-4fce-9502-bff1bb385d08 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:39.193002 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-3a674b7b-b4d2-4fce-9502-bff1bb385d08 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1741 microversion: 2.20 time: 0.324803 Jul 13 02:29:39.194616 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 227/452] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:29:38 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1741 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:29:39.907386 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-62fdc9fc-683d-49e1-8484-084e02034d72 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:39.907962 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-62fdc9fc-683d-49e1-8484-084e02034d72 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: e522ea39-8cb0-4f4f-8346-d951228edeaf] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:39.914956 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-62fdc9fc-683d-49e1-8484-084e02034d72 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:39.915403 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-62fdc9fc-683d-49e1-8484-084e02034d72 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:39.916172 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-62fdc9fc-683d-49e1-8484-084e02034d72 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:39.916596 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-62fdc9fc-683d-49e1-8484-084e02034d72 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:39.919755 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:39.919755 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:40.070016 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3031: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:40.070016 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context, Jul 13 02:29:40.077193 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.objects.instance [None req-62fdc9fc-683d-49e1-8484-084e02034d72 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lazy-loading 'services' on Instance uuid e522ea39-8cb0-4f4f-8346-d951228edeaf {{(pid=107262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 13 02:29:40.153128 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-62fdc9fc-683d-49e1-8484-084e02034d72 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf/os-volume_attachments/739be4c7-a2f8-49b9-94df-9915fa5d35b5" status: 202 len: 0 microversion: 2.1 time: 0.249598 Jul 13 02:29:40.153710 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 226/453] 10.222.0.32 () {58 vars in 1416 bytes} [Tue Jul 13 02:29:39 2021] DELETE /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf/os-volume_attachments/739be4c7-a2f8-49b9-94df-9915fa5d35b5 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:29:40.213887 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-d86a30fb-a5ed-4092-8f4e-20a5478dd096 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:40.214672 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-d86a30fb-a5ed-4092-8f4e-20a5478dd096 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:40.230690 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d86a30fb-a5ed-4092-8f4e-20a5478dd096 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:40.231485 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d86a30fb-a5ed-4092-8f4e-20a5478dd096 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:40.232287 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d86a30fb-a5ed-4092-8f4e-20a5478dd096 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:40.232714 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d86a30fb-a5ed-4092-8f4e-20a5478dd096 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:40.235968 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:40.235968 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:40.443030 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-d86a30fb-a5ed-4092-8f4e-20a5478dd096 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:40.447730 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:40.447730 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:40.461081 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-d86a30fb-a5ed-4092-8f4e-20a5478dd096 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:40.462903 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-d86a30fb-a5ed-4092-8f4e-20a5478dd096 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:40.464233 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-d86a30fb-a5ed-4092-8f4e-20a5478dd096 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1741 microversion: 2.20 time: 0.255564 Jul 13 02:29:40.474697 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 228/454] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:29:40 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1741 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:29:41.499587 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-455911d9-838e-4d9d-9a14-b58be4e1c4e9 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:41.501206 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-455911d9-838e-4d9d-9a14-b58be4e1c4e9 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:41.509304 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-455911d9-838e-4d9d-9a14-b58be4e1c4e9 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:41.522680 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-455911d9-838e-4d9d-9a14-b58be4e1c4e9 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:41.524184 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-455911d9-838e-4d9d-9a14-b58be4e1c4e9 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:41.524644 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-455911d9-838e-4d9d-9a14-b58be4e1c4e9 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:41.530797 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:41.530797 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:41.735666 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-455911d9-838e-4d9d-9a14-b58be4e1c4e9 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:41.738469 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:41.738469 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:41.746803 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-455911d9-838e-4d9d-9a14-b58be4e1c4e9 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:41.748562 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-455911d9-838e-4d9d-9a14-b58be4e1c4e9 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:41.749718 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-455911d9-838e-4d9d-9a14-b58be4e1c4e9 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1741 microversion: 2.20 time: 0.265881 Jul 13 02:29:41.761210 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 227/455] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:29:41 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1741 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:29:42.767542 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-f923f4b6-5b76-4c24-b482-bd446599ae50 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:42.772786 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-f923f4b6-5b76-4c24-b482-bd446599ae50 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:42.779575 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f923f4b6-5b76-4c24-b482-bd446599ae50 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:42.780135 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f923f4b6-5b76-4c24-b482-bd446599ae50 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:42.781005 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f923f4b6-5b76-4c24-b482-bd446599ae50 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:42.781538 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f923f4b6-5b76-4c24-b482-bd446599ae50 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:42.785019 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:42.785019 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:42.994215 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-f923f4b6-5b76-4c24-b482-bd446599ae50 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:42.997535 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:42.997535 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:43.005023 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-f923f4b6-5b76-4c24-b482-bd446599ae50 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:43.007379 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-f923f4b6-5b76-4c24-b482-bd446599ae50 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:43.008807 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-f923f4b6-5b76-4c24-b482-bd446599ae50 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1741 microversion: 2.20 time: 0.244986 Jul 13 02:29:43.009557 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 229/456] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:29:42 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1741 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:29:44.027628 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-370d40be-80c1-4cb0-a68b-704865995b86 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:44.028245 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-370d40be-80c1-4cb0-a68b-704865995b86 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:44.034921 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-370d40be-80c1-4cb0-a68b-704865995b86 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:44.035361 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-370d40be-80c1-4cb0-a68b-704865995b86 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:44.036145 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-370d40be-80c1-4cb0-a68b-704865995b86 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:44.036571 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-370d40be-80c1-4cb0-a68b-704865995b86 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:44.040555 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:44.040555 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:44.242981 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-370d40be-80c1-4cb0-a68b-704865995b86 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:44.246414 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:44.246414 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:44.258329 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-370d40be-80c1-4cb0-a68b-704865995b86 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:44.260227 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-370d40be-80c1-4cb0-a68b-704865995b86 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:44.261831 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-370d40be-80c1-4cb0-a68b-704865995b86 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1741 microversion: 2.20 time: 0.237601 Jul 13 02:29:44.271615 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 228/457] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:29:44 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1741 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:29:45.297742 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-b54e44dc-1530-400b-b96b-431fa72f5bc2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:45.298532 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-b54e44dc-1530-400b-b96b-431fa72f5bc2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:45.305535 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b54e44dc-1530-400b-b96b-431fa72f5bc2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:45.305984 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b54e44dc-1530-400b-b96b-431fa72f5bc2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:45.306790 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b54e44dc-1530-400b-b96b-431fa72f5bc2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:45.307413 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b54e44dc-1530-400b-b96b-431fa72f5bc2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:45.310457 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:45.310457 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:45.496772 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-b54e44dc-1530-400b-b96b-431fa72f5bc2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:45.500272 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:45.500272 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:45.508681 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-b54e44dc-1530-400b-b96b-431fa72f5bc2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:45.510530 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-b54e44dc-1530-400b-b96b-431fa72f5bc2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:45.511776 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-b54e44dc-1530-400b-b96b-431fa72f5bc2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1741 microversion: 2.20 time: 0.217880 Jul 13 02:29:45.523262 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 230/458] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:29:45 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1741 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:29:46.531249 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-b4cd1a52-11eb-4415-9866-0ecb17545f42 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:46.532684 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-b4cd1a52-11eb-4415-9866-0ecb17545f42 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:46.539223 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b4cd1a52-11eb-4415-9866-0ecb17545f42 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:46.539688 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b4cd1a52-11eb-4415-9866-0ecb17545f42 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:46.540458 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b4cd1a52-11eb-4415-9866-0ecb17545f42 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:46.541079 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b4cd1a52-11eb-4415-9866-0ecb17545f42 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:46.544314 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:46.544314 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:46.737418 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-b4cd1a52-11eb-4415-9866-0ecb17545f42 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:46.740676 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:46.740676 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:46.748479 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-b4cd1a52-11eb-4415-9866-0ecb17545f42 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:46.749972 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-b4cd1a52-11eb-4415-9866-0ecb17545f42 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:46.751270 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-b4cd1a52-11eb-4415-9866-0ecb17545f42 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1741 microversion: 2.20 time: 0.224433 Jul 13 02:29:46.751930 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 229/459] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:29:46 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1741 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:29:47.770132 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-c54d666c-41e4-49dc-874f-7b070a4dd137 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:47.770777 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-c54d666c-41e4-49dc-874f-7b070a4dd137 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:47.779219 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c54d666c-41e4-49dc-874f-7b070a4dd137 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:47.779925 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c54d666c-41e4-49dc-874f-7b070a4dd137 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:47.781045 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c54d666c-41e4-49dc-874f-7b070a4dd137 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:47.781655 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c54d666c-41e4-49dc-874f-7b070a4dd137 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:47.785283 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:47.785283 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:47.989259 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-c54d666c-41e4-49dc-874f-7b070a4dd137 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:47.992399 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:47.992399 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:47.999712 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-c54d666c-41e4-49dc-874f-7b070a4dd137 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:48.001209 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-c54d666c-41e4-49dc-874f-7b070a4dd137 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:48.002391 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-c54d666c-41e4-49dc-874f-7b070a4dd137 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1741 microversion: 2.20 time: 0.236134 Jul 13 02:29:48.002941 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 231/460] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:29:47 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1741 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:29:48.065488 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-aef991e9-96b3-4e05-8ce3-be2ed944c73b tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:29:48.066644 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-aef991e9-96b3-4e05-8ce3-be2ed944c73b tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:48.073811 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-aef991e9-96b3-4e05-8ce3-be2ed944c73b tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:48.074293 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-aef991e9-96b3-4e05-8ce3-be2ed944c73b tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:48.075254 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-aef991e9-96b3-4e05-8ce3-be2ed944c73b tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:48.075738 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-aef991e9-96b3-4e05-8ce3-be2ed944c73b tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:48.078628 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:48.078628 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:48.138168 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.objects.instance [None req-aef991e9-96b3-4e05-8ce3-be2ed944c73b tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lazy-loading 'flavor' on Instance uuid 163ad440-5d5c-420d-ab44-52f27c5e22dc {{(pid=107262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 13 02:29:48.186079 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3008: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:48.186079 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).\ Jul 13 02:29:48.256053 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2557: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:48.256053 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: rows_updated = model_query(context, models.InstanceExtra).\ Jul 13 02:29:48.264961 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:48.264961 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:48.331741 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/update_match.py:472: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:48.331741 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = query.session.execute(update_stmt) Jul 13 02:29:48.355109 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-aef991e9-96b3-4e05-8ce3-be2ed944c73b tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "POST /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc/action" status: 200 len: 32 microversion: 2.1 time: 0.293669 Jul 13 02:29:48.355717 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 230/461] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:29:48 2021] POST /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc/action => generated 32 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 13 02:29:48.364445 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-e8ee3518-800b-49b7-b448-dde99ee4ba0f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:48.365052 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-e8ee3518-800b-49b7-b448-dde99ee4ba0f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:48.371557 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e8ee3518-800b-49b7-b448-dde99ee4ba0f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:48.371996 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e8ee3518-800b-49b7-b448-dde99ee4ba0f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:48.372750 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e8ee3518-800b-49b7-b448-dde99ee4ba0f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:48.373185 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e8ee3518-800b-49b7-b448-dde99ee4ba0f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:48.376079 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:48.376079 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:48.555660 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-e8ee3518-800b-49b7-b448-dde99ee4ba0f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:48.558291 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:48.558291 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:48.565777 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-e8ee3518-800b-49b7-b448-dde99ee4ba0f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1566 microversion: 2.1 time: 0.204983 Jul 13 02:29:48.566386 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 232/462] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:48 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1566 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:49.021019 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-a970d004-419b-46c8-8b0d-c22aec8101b1 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:49.021724 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-a970d004-419b-46c8-8b0d-c22aec8101b1 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:49.028388 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a970d004-419b-46c8-8b0d-c22aec8101b1 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:49.028839 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a970d004-419b-46c8-8b0d-c22aec8101b1 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:49.029608 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a970d004-419b-46c8-8b0d-c22aec8101b1 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:49.030072 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a970d004-419b-46c8-8b0d-c22aec8101b1 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:49.032988 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:49.032988 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:49.266756 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-0216e5c0-7891-4e98-9ee1-97560d22ff83 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:49.267327 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-0216e5c0-7891-4e98-9ee1-97560d22ff83 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 97a3e7df-5271-4585-b962-e014adc2c87b] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:49.273596 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0216e5c0-7891-4e98-9ee1-97560d22ff83 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:49.274072 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0216e5c0-7891-4e98-9ee1-97560d22ff83 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:49.274852 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0216e5c0-7891-4e98-9ee1-97560d22ff83 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:49.275288 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0216e5c0-7891-4e98-9ee1-97560d22ff83 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:49.278259 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:49.278259 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:49.343220 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-0216e5c0-7891-4e98-9ee1-97560d22ff83 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 97a3e7df-5271-4585-b962-e014adc2c87b] Going to try to terminate instance {{(pid=107263) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 13 02:29:49.345396 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3008: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:49.345396 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).\ Jul 13 02:29:49.358701 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:49.358701 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:49.385840 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-a970d004-419b-46c8-8b0d-c22aec8101b1 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:49.393653 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:49.393653 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:49.404071 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-a970d004-419b-46c8-8b0d-c22aec8101b1 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:49.405732 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-a970d004-419b-46c8-8b0d-c22aec8101b1 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:49.407065 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-a970d004-419b-46c8-8b0d-c22aec8101b1 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1723 microversion: 2.20 time: 0.390119 Jul 13 02:29:49.407742 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 231/463] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:29:49 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1723 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:29:49.419385 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/update_match.py:472: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:49.419385 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = query.session.execute(update_stmt) Jul 13 02:29:49.434354 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:530: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:49.434354 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = model_query(context, models.Service, read_deleted="no").\ Jul 13 02:29:49.471955 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-0216e5c0-7891-4e98-9ee1-97560d22ff83 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "DELETE /compute/v2.1/servers/97a3e7df-5271-4585-b962-e014adc2c87b" status: 204 len: 0 microversion: 2.1 time: 0.208539 Jul 13 02:29:49.472543 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 233/464] 10.222.0.32 () {58 vars in 1239 bytes} [Tue Jul 13 02:29:49 2021] DELETE /compute/v2.1/servers/97a3e7df-5271-4585-b962-e014adc2c87b => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 13 02:29:49.481346 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-fd73de1a-e3d9-439d-8a1c-abad4cf28131 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:49.482075 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-fd73de1a-e3d9-439d-8a1c-abad4cf28131 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 97a3e7df-5271-4585-b962-e014adc2c87b] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:49.487745 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-fd73de1a-e3d9-439d-8a1c-abad4cf28131 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:49.488182 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-fd73de1a-e3d9-439d-8a1c-abad4cf28131 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:49.488939 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-fd73de1a-e3d9-439d-8a1c-abad4cf28131 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:49.489369 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-fd73de1a-e3d9-439d-8a1c-abad4cf28131 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:49.493165 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:49.493165 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:49.582492 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-2d512b63-eb95-4174-98fa-dcd8f027185e tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:49.583202 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-2d512b63-eb95-4174-98fa-dcd8f027185e tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:49.589874 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2d512b63-eb95-4174-98fa-dcd8f027185e tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:49.590355 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2d512b63-eb95-4174-98fa-dcd8f027185e tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:49.591318 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2d512b63-eb95-4174-98fa-dcd8f027185e tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:49.591766 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2d512b63-eb95-4174-98fa-dcd8f027185e tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:49.595200 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:49.595200 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:50.025156 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-fd73de1a-e3d9-439d-8a1c-abad4cf28131 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21025e2c8aa9423dbd05da95f237b481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2c1d46685432e8656123be9d86664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:50.028267 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:50.028267 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:50.035495 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-fd73de1a-e3d9-439d-8a1c-abad4cf28131 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "GET /compute/v2.1/servers/97a3e7df-5271-4585-b962-e014adc2c87b" status: 200 len: 1513 microversion: 2.1 time: 0.558420 Jul 13 02:29:50.036195 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 232/465] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:49 2021] GET /compute/v2.1/servers/97a3e7df-5271-4585-b962-e014adc2c87b => generated 1513 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:29:50.140913 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-2d512b63-eb95-4174-98fa-dcd8f027185e tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:50.143620 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:50.143620 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:50.151136 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-2d512b63-eb95-4174-98fa-dcd8f027185e tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1566 microversion: 2.1 time: 0.572689 Jul 13 02:29:50.151728 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 234/466] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:49 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1566 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:29:50.425790 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-6dbdcae8-a41f-4d1b-87cc-5ae15f89fb2e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:50.426417 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-6dbdcae8-a41f-4d1b-87cc-5ae15f89fb2e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:50.433185 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-6dbdcae8-a41f-4d1b-87cc-5ae15f89fb2e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:50.433615 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-6dbdcae8-a41f-4d1b-87cc-5ae15f89fb2e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:50.434400 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-6dbdcae8-a41f-4d1b-87cc-5ae15f89fb2e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:50.434827 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-6dbdcae8-a41f-4d1b-87cc-5ae15f89fb2e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:50.438242 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:50.438242 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:50.609945 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-6dbdcae8-a41f-4d1b-87cc-5ae15f89fb2e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:50.612529 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:50.612529 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:50.619993 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-6dbdcae8-a41f-4d1b-87cc-5ae15f89fb2e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:50.621485 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-6dbdcae8-a41f-4d1b-87cc-5ae15f89fb2e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:50.622646 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-6dbdcae8-a41f-4d1b-87cc-5ae15f89fb2e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1723 microversion: 2.20 time: 0.200577 Jul 13 02:29:50.623198 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 233/467] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:29:50 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:29:51.052611 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-e32ed43f-0046-4166-adff-23c271f7d61e tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:51.053861 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-e32ed43f-0046-4166-adff-23c271f7d61e tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 97a3e7df-5271-4585-b962-e014adc2c87b] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:51.059692 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e32ed43f-0046-4166-adff-23c271f7d61e tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:51.060133 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e32ed43f-0046-4166-adff-23c271f7d61e tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:51.060896 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e32ed43f-0046-4166-adff-23c271f7d61e tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:51.061323 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e32ed43f-0046-4166-adff-23c271f7d61e tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:51.064201 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:51.064201 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:51.168272 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-f5de81b1-9281-4dd6-aff4-d56c800ab945 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:51.168799 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-f5de81b1-9281-4dd6-aff4-d56c800ab945 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:51.174689 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f5de81b1-9281-4dd6-aff4-d56c800ab945 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:51.175136 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f5de81b1-9281-4dd6-aff4-d56c800ab945 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:51.175909 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f5de81b1-9281-4dd6-aff4-d56c800ab945 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:51.176344 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f5de81b1-9281-4dd6-aff4-d56c800ab945 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:51.179801 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:51.179801 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:51.247934 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-e32ed43f-0046-4166-adff-23c271f7d61e tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21025e2c8aa9423dbd05da95f237b481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2c1d46685432e8656123be9d86664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:51.250584 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:51.250584 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:51.257875 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-e32ed43f-0046-4166-adff-23c271f7d61e tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "GET /compute/v2.1/servers/97a3e7df-5271-4585-b962-e014adc2c87b" status: 200 len: 1513 microversion: 2.1 time: 0.208961 Jul 13 02:29:51.258487 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 235/468] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:51 2021] GET /compute/v2.1/servers/97a3e7df-5271-4585-b962-e014adc2c87b => generated 1513 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:51.357281 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-f5de81b1-9281-4dd6-aff4-d56c800ab945 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:51.359851 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:51.359851 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:51.367405 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-f5de81b1-9281-4dd6-aff4-d56c800ab945 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1566 microversion: 2.1 time: 0.202854 Jul 13 02:29:51.367973 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 234/469] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:51 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1566 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:29:51.641492 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-6cfad75c-96f9-44c2-85f6-68a9c60da9e8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:51.642127 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-6cfad75c-96f9-44c2-85f6-68a9c60da9e8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:51.648695 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6cfad75c-96f9-44c2-85f6-68a9c60da9e8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:51.649143 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6cfad75c-96f9-44c2-85f6-68a9c60da9e8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:51.649903 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6cfad75c-96f9-44c2-85f6-68a9c60da9e8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:51.650369 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6cfad75c-96f9-44c2-85f6-68a9c60da9e8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:51.653206 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:51.653206 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:51.825599 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-6cfad75c-96f9-44c2-85f6-68a9c60da9e8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:51.828167 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:51.828167 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:51.836016 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-6cfad75c-96f9-44c2-85f6-68a9c60da9e8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:51.837504 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-6cfad75c-96f9-44c2-85f6-68a9c60da9e8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:51.838655 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-6cfad75c-96f9-44c2-85f6-68a9c60da9e8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1723 microversion: 2.20 time: 0.201192 Jul 13 02:29:51.839222 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 236/470] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:29:51 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:29:52.012402 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-abde58e5-cc69-4867-944a-13c25f98ea54 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:52.013188 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-abde58e5-cc69-4867-944a-13c25f98ea54 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: e522ea39-8cb0-4f4f-8346-d951228edeaf] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:52.018915 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-abde58e5-cc69-4867-944a-13c25f98ea54 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:52.019352 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-abde58e5-cc69-4867-944a-13c25f98ea54 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:52.020112 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-abde58e5-cc69-4867-944a-13c25f98ea54 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:52.020536 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-abde58e5-cc69-4867-944a-13c25f98ea54 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:52.024128 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:52.024128 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:52.087801 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-abde58e5-cc69-4867-944a-13c25f98ea54 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: e522ea39-8cb0-4f4f-8346-d951228edeaf] Going to try to terminate instance {{(pid=107262) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 13 02:29:52.090377 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3008: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:52.090377 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).\ Jul 13 02:29:52.103621 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:52.103621 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:52.159897 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/update_match.py:472: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:52.159897 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = query.session.execute(update_stmt) Jul 13 02:29:52.175101 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:530: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:52.175101 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = model_query(context, models.Service, read_deleted="no").\ Jul 13 02:29:52.213985 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-abde58e5-cc69-4867-944a-13c25f98ea54 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "DELETE /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf" status: 204 len: 0 microversion: 2.1 time: 0.204987 Jul 13 02:29:52.214591 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 235/471] 10.222.0.32 () {58 vars in 1239 bytes} [Tue Jul 13 02:29:52 2021] DELETE /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 13 02:29:52.222578 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-108c1b26-bcda-4d27-a1de-ffa44597ff15 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:52.223190 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-108c1b26-bcda-4d27-a1de-ffa44597ff15 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: e522ea39-8cb0-4f4f-8346-d951228edeaf] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:52.229040 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-108c1b26-bcda-4d27-a1de-ffa44597ff15 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:52.229481 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-108c1b26-bcda-4d27-a1de-ffa44597ff15 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:52.230278 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-108c1b26-bcda-4d27-a1de-ffa44597ff15 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:52.230748 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-108c1b26-bcda-4d27-a1de-ffa44597ff15 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:52.235229 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:52.235229 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:52.275441 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-c811db84-2fcb-454b-8fe4-627a711d36ab tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:52.276143 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-c811db84-2fcb-454b-8fe4-627a711d36ab tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 97a3e7df-5271-4585-b962-e014adc2c87b] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:52.281992 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c811db84-2fcb-454b-8fe4-627a711d36ab tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:52.282470 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c811db84-2fcb-454b-8fe4-627a711d36ab tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:52.283244 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c811db84-2fcb-454b-8fe4-627a711d36ab tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:52.283678 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c811db84-2fcb-454b-8fe4-627a711d36ab tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:52.286629 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:52.286629 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:52.466087 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-108c1b26-bcda-4d27-a1de-ffa44597ff15 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:52.468707 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:52.468707 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:52.476102 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-108c1b26-bcda-4d27-a1de-ffa44597ff15 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf" status: 200 len: 1514 microversion: 2.1 time: 0.257230 Jul 13 02:29:52.476685 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 237/472] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:52 2021] GET /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf => generated 1514 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:52.486203 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-51a7c2ab-5c03-4d79-8d46-6096c0ec747f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:52.486203 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-51a7c2ab-5c03-4d79-8d46-6096c0ec747f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:52.487506 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-51a7c2ab-5c03-4d79-8d46-6096c0ec747f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:52.487956 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-51a7c2ab-5c03-4d79-8d46-6096c0ec747f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:52.488728 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-51a7c2ab-5c03-4d79-8d46-6096c0ec747f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:52.489165 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-51a7c2ab-5c03-4d79-8d46-6096c0ec747f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:52.492849 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:52.492849 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:52.550877 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-c811db84-2fcb-454b-8fe4-627a711d36ab tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21025e2c8aa9423dbd05da95f237b481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2c1d46685432e8656123be9d86664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:52.554205 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:52.554205 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:52.561477 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-c811db84-2fcb-454b-8fe4-627a711d36ab tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "GET /compute/v2.1/servers/97a3e7df-5271-4585-b962-e014adc2c87b" status: 200 len: 1513 microversion: 2.1 time: 0.290117 Jul 13 02:29:52.568236 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 236/473] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:52 2021] GET /compute/v2.1/servers/97a3e7df-5271-4585-b962-e014adc2c87b => generated 1513 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:29:52.644210 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-6693d73a-9209-4649-9346-b84db09b6110 req-0748cdef-fd2a-4e03-aee7-c10b0e24d308 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "872b8d83-fdcf-4888-b1d3-64f49541426d", "name": "network-vif-unplugged", "status": "completed", "tag": "49588aa8-e16a-42d4-9d7e-8c1cf67a6211"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:29:52.645789 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:29:52.645789 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:29:52.653122 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-6693d73a-9209-4649-9346-b84db09b6110 req-0748cdef-fd2a-4e03-aee7-c10b0e24d308 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:52.653568 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-6693d73a-9209-4649-9346-b84db09b6110 req-0748cdef-fd2a-4e03-aee7-c10b0e24d308 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:52.666626 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-6693d73a-9209-4649-9346-b84db09b6110 req-0748cdef-fd2a-4e03-aee7-c10b0e24d308 service nova] Creating event network-vif-unplugged:49588aa8-e16a-42d4-9d7e-8c1cf67a6211 for instance 872b8d83-fdcf-4888-b1d3-64f49541426d on hv-cinder-78102 Jul 13 02:29:52.671602 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-6693d73a-9209-4649-9346-b84db09b6110 req-0748cdef-fd2a-4e03-aee7-c10b0e24d308 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031131 Jul 13 02:29:52.672562 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 237/474] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:29:52 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 02:29:52.771523 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-51a7c2ab-5c03-4d79-8d46-6096c0ec747f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:52.774775 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:52.774775 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:52.782732 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-51a7c2ab-5c03-4d79-8d46-6096c0ec747f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1566 microversion: 2.1 time: 0.304879 Jul 13 02:29:52.783361 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 238/475] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:52 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1566 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:52.857943 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-dd3d7a0d-0485-4c48-993b-a9ee2771d8c3 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:52.858773 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-dd3d7a0d-0485-4c48-993b-a9ee2771d8c3 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:52.865109 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-dd3d7a0d-0485-4c48-993b-a9ee2771d8c3 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:52.866270 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-dd3d7a0d-0485-4c48-993b-a9ee2771d8c3 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:52.867124 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-dd3d7a0d-0485-4c48-993b-a9ee2771d8c3 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:52.867627 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-dd3d7a0d-0485-4c48-993b-a9ee2771d8c3 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:52.870692 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:52.870692 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:53.134859 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [req-e7f4a1ab-b6d7-485a-a806-140becdf6f08 req-e0b03c37-ec13-4a47-baf6-5655ba4e4e01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97a3e7df-5271-4585-b962-e014adc2c87b", "name": "network-vif-deleted", "tag": "806abd81-b203-4b96-891c-6f415ed06825"}]} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:29:53.136655 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:29:53.136655 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: warnings.warn(msg) Jul 13 02:29:53.154315 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-e7f4a1ab-b6d7-485a-a806-140becdf6f08 req-e0b03c37-ec13-4a47-baf6-5655ba4e4e01 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:53.154924 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-e7f4a1ab-b6d7-485a-a806-140becdf6f08 req-e0b03c37-ec13-4a47-baf6-5655ba4e4e01 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:53.171203 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.compute.server_external_events [req-e7f4a1ab-b6d7-485a-a806-140becdf6f08 req-e0b03c37-ec13-4a47-baf6-5655ba4e4e01 service nova] Creating event network-vif-deleted:806abd81-b203-4b96-891c-6f415ed06825 for instance 97a3e7df-5271-4585-b962-e014adc2c87b on hv-cinder-78102 Jul 13 02:29:53.181933 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-dd3d7a0d-0485-4c48-993b-a9ee2771d8c3 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:53.185649 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:53.185649 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:53.190083 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [req-e7f4a1ab-b6d7-485a-a806-140becdf6f08 req-e0b03c37-ec13-4a47-baf6-5655ba4e4e01 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059623 Jul 13 02:29:53.196610 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-dd3d7a0d-0485-4c48-993b-a9ee2771d8c3 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:53.197436 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 239/476] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:29:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:29:53.199654 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-dd3d7a0d-0485-4c48-993b-a9ee2771d8c3 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:53.201549 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-dd3d7a0d-0485-4c48-993b-a9ee2771d8c3 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1723 microversion: 2.20 time: 0.348120 Jul 13 02:29:53.202242 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 238/477] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:29:52 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1723 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:29:53.494053 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-80a9513d-392f-4770-8b88-34d1ef17b4a9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:53.494764 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-80a9513d-392f-4770-8b88-34d1ef17b4a9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: e522ea39-8cb0-4f4f-8346-d951228edeaf] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:53.501193 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-80a9513d-392f-4770-8b88-34d1ef17b4a9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:53.501421 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-80a9513d-392f-4770-8b88-34d1ef17b4a9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:53.502192 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-80a9513d-392f-4770-8b88-34d1ef17b4a9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:53.502666 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-80a9513d-392f-4770-8b88-34d1ef17b4a9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:53.505538 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:53.505538 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:53.578626 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-7e32bdfe-5ec7-46ad-9077-14f5800455c1 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:53.579145 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-7e32bdfe-5ec7-46ad-9077-14f5800455c1 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 97a3e7df-5271-4585-b962-e014adc2c87b] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:53.585612 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7e32bdfe-5ec7-46ad-9077-14f5800455c1 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:53.586073 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7e32bdfe-5ec7-46ad-9077-14f5800455c1 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:53.586837 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7e32bdfe-5ec7-46ad-9077-14f5800455c1 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:53.587266 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7e32bdfe-5ec7-46ad-9077-14f5800455c1 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:53.590821 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:53.590821 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:53.666383 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7e32bdfe-5ec7-46ad-9077-14f5800455c1 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:53.666830 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7e32bdfe-5ec7-46ad-9077-14f5800455c1 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:53.667274 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.objects.instance [None req-7e32bdfe-5ec7-46ad-9077-14f5800455c1 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lazy-loading 'fault' on Instance uuid 97a3e7df-5271-4585-b962-e014adc2c87b {{(pid=107262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 13 02:29:53.669452 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:4002: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:53.669452 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: for row in query: Jul 13 02:29:53.697386 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-80a9513d-392f-4770-8b88-34d1ef17b4a9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:53.700077 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:53.700077 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:53.706996 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-80a9513d-392f-4770-8b88-34d1ef17b4a9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf" status: 200 len: 1514 microversion: 2.1 time: 0.216944 Jul 13 02:29:53.707564 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 240/478] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:53 2021] GET /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf => generated 1514 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:53.715344 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-7e32bdfe-5ec7-46ad-9077-14f5800455c1 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21025e2c8aa9423dbd05da95f237b481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2c1d46685432e8656123be9d86664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:53.717825 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:53.717825 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:53.724602 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-7e32bdfe-5ec7-46ad-9077-14f5800455c1 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "GET /compute/v2.1/servers/97a3e7df-5271-4585-b962-e014adc2c87b" status: 200 len: 1308 microversion: 2.1 time: 0.149680 Jul 13 02:29:53.725782 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 239/479] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:53 2021] GET /compute/v2.1/servers/97a3e7df-5271-4585-b962-e014adc2c87b => generated 1308 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:29:53.798653 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-f36143a2-4560-4e6f-b418-7daa11218449 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:53.799552 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-f36143a2-4560-4e6f-b418-7daa11218449 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:53.805837 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f36143a2-4560-4e6f-b418-7daa11218449 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:53.806300 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f36143a2-4560-4e6f-b418-7daa11218449 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:53.807069 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f36143a2-4560-4e6f-b418-7daa11218449 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:53.807508 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f36143a2-4560-4e6f-b418-7daa11218449 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:53.810425 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:53.810425 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:53.997960 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-f36143a2-4560-4e6f-b418-7daa11218449 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:54.000877 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:54.000877 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:54.009032 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-f36143a2-4560-4e6f-b418-7daa11218449 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1566 microversion: 2.1 time: 0.214041 Jul 13 02:29:54.009611 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 241/480] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:53 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1566 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:54.220068 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-b207ee25-d14c-4b1a-bcca-1a11f672ffef tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:54.220590 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-b207ee25-d14c-4b1a-bcca-1a11f672ffef tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:54.226660 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b207ee25-d14c-4b1a-bcca-1a11f672ffef tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:54.227102 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b207ee25-d14c-4b1a-bcca-1a11f672ffef tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:54.227867 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b207ee25-d14c-4b1a-bcca-1a11f672ffef tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:54.228301 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b207ee25-d14c-4b1a-bcca-1a11f672ffef tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:54.231163 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:54.231163 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:54.408143 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-b207ee25-d14c-4b1a-bcca-1a11f672ffef tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:54.410696 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:54.410696 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:54.418075 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-b207ee25-d14c-4b1a-bcca-1a11f672ffef tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:54.419576 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-b207ee25-d14c-4b1a-bcca-1a11f672ffef tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:54.420718 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-b207ee25-d14c-4b1a-bcca-1a11f672ffef tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1666 microversion: 2.20 time: 0.204430 Jul 13 02:29:54.421267 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 240/481] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:29:54 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1666 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:29:54.438501 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-f7b7a594-99e6-4933-b7f1-6ae80b1795b6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "016a8612-b5c6-4a9a-aae0-5a7e13557b36"}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:29:54.439817 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-f7b7a594-99e6-4933-b7f1-6ae80b1795b6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:54.446420 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f7b7a594-99e6-4933-b7f1-6ae80b1795b6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:54.446871 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f7b7a594-99e6-4933-b7f1-6ae80b1795b6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:54.447638 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f7b7a594-99e6-4933-b7f1-6ae80b1795b6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:54.448072 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f7b7a594-99e6-4933-b7f1-6ae80b1795b6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:54.450808 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:54.450808 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:54.562541 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3019: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:54.562541 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context, Jul 13 02:29:54.663329 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2940: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:54.663329 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: query.update(values) Jul 13 02:29:54.665583 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2941: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:54.665583 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return query.first() Jul 13 02:29:54.681063 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:4073: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:54.681063 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = model_query(context, models.InstanceAction).\ Jul 13 02:29:54.697378 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-2d76f425-126f-4af6-a0fb-ab60b19af8bd req-1adcc2d1-82d4-4e73-b57f-6a34ad877e07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "872b8d83-fdcf-4888-b1d3-64f49541426d", "name": "network-vif-plugged", "status": "completed", "tag": "49588aa8-e16a-42d4-9d7e-8c1cf67a6211"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:29:54.699097 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:29:54.699097 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:29:54.706405 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-2d76f425-126f-4af6-a0fb-ab60b19af8bd req-1adcc2d1-82d4-4e73-b57f-6a34ad877e07 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:54.706883 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-2d76f425-126f-4af6-a0fb-ab60b19af8bd req-1adcc2d1-82d4-4e73-b57f-6a34ad877e07 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:54.721417 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.compute.server_external_events [req-2d76f425-126f-4af6-a0fb-ab60b19af8bd req-1adcc2d1-82d4-4e73-b57f-6a34ad877e07 service nova] Unable to find a host for instance 872b8d83-fdcf-4888-b1d3-64f49541426d. Dropping event network-vif-plugged {{(pid=107262) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:138}} Jul 13 02:29:54.722326 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-2d76f425-126f-4af6-a0fb-ab60b19af8bd req-1adcc2d1-82d4-4e73-b57f-6a34ad877e07 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.030170 Jul 13 02:29:54.722916 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 241/482] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:29:54 2021] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 13 02:29:54.728425 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-cbdd9483-879a-4b9e-8f8c-d300986063ee tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:54.729030 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-cbdd9483-879a-4b9e-8f8c-d300986063ee tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: e522ea39-8cb0-4f4f-8346-d951228edeaf] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:54.735918 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-cbdd9483-879a-4b9e-8f8c-d300986063ee tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:54.736412 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-cbdd9483-879a-4b9e-8f8c-d300986063ee tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:54.737230 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-cbdd9483-879a-4b9e-8f8c-d300986063ee tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:54.737692 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-cbdd9483-879a-4b9e-8f8c-d300986063ee tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:54.741495 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:54.741495 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:54.769729 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:4158: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:54.769729 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: event_ref = model_query(context, models.InstanceActionEvent).\ Jul 13 02:29:54.784329 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-f7b7a594-99e6-4933-b7f1-6ae80b1795b6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.349519 Jul 13 02:29:54.785091 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 242/483] 10.222.0.32 () {62 vars in 1364 bytes} [Tue Jul 13 02:29:54 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/os-volume_attachments => generated 188 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:29:54.790312 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-50065dd6-8012-4866-8d90-d042a16477ef tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:54.791050 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-50065dd6-8012-4866-8d90-d042a16477ef tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 97a3e7df-5271-4585-b962-e014adc2c87b] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:54.797037 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-50065dd6-8012-4866-8d90-d042a16477ef tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:54.797542 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-50065dd6-8012-4866-8d90-d042a16477ef tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:54.798289 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-50065dd6-8012-4866-8d90-d042a16477ef tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:54.798774 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-50065dd6-8012-4866-8d90-d042a16477ef tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:54.801841 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:54.801841 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:54.847207 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.wsgi [None req-50065dd6-8012-4866-8d90-d042a16477ef tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] HTTP exception thrown: Instance 97a3e7df-5271-4585-b962-e014adc2c87b could not be found. Jul 13 02:29:54.848025 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-50065dd6-8012-4866-8d90-d042a16477ef tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Returning 404 to user: Instance 97a3e7df-5271-4585-b962-e014adc2c87b could not be found. {{(pid=107263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:29:54.849150 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-50065dd6-8012-4866-8d90-d042a16477ef tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "GET /compute/v2.1/servers/97a3e7df-5271-4585-b962-e014adc2c87b" status: 404 len: 111 microversion: 2.1 time: 0.063058 Jul 13 02:29:54.850241 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 243/484] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:54 2021] GET /compute/v2.1/servers/97a3e7df-5271-4585-b962-e014adc2c87b => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 02:29:54.859225 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-dc35389b-620b-4318-b38e-3ff5a4b6c40a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:29:54.860084 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-dc35389b-620b-4318-b38e-3ff5a4b6c40a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:54.867231 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-dc35389b-620b-4318-b38e-3ff5a4b6c40a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:54.867681 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-dc35389b-620b-4318-b38e-3ff5a4b6c40a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:54.868457 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-dc35389b-620b-4318-b38e-3ff5a4b6c40a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:54.871043 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-dc35389b-620b-4318-b38e-3ff5a4b6c40a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:54.874528 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:54.874528 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:54.950645 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-cbdd9483-879a-4b9e-8f8c-d300986063ee tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:54.953858 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:54.953858 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:54.954072 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:54.954072 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:54.963239 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-cbdd9483-879a-4b9e-8f8c-d300986063ee tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf" status: 200 len: 1514 microversion: 2.1 time: 0.239304 Jul 13 02:29:54.963820 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 242/485] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:54 2021] GET /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf => generated 1514 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:55.024769 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/update_match.py:472: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:55.024769 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = query.session.execute(update_stmt) Jul 13 02:29:55.026321 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-67d6b1a0-7ec8-4d0e-84c9-5613700095c6 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:55.027022 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-67d6b1a0-7ec8-4d0e-84c9-5613700095c6 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:55.033820 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-67d6b1a0-7ec8-4d0e-84c9-5613700095c6 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:55.034547 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-67d6b1a0-7ec8-4d0e-84c9-5613700095c6 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:55.036014 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-67d6b1a0-7ec8-4d0e-84c9-5613700095c6 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:55.036500 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-67d6b1a0-7ec8-4d0e-84c9-5613700095c6 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:55.039991 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:55.039991 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:55.059332 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-dc35389b-620b-4318-b38e-3ff5a4b6c40a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action" status: 202 len: 0 microversion: 2.20 time: 0.203881 Jul 13 02:29:55.060222 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 244/486] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:29:54 2021] POST /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 13 02:29:55.067873 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-e17bdf9c-fed9-466e-951f-0e02bb34fe9b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:55.069594 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-e17bdf9c-fed9-466e-951f-0e02bb34fe9b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:55.075913 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e17bdf9c-fed9-466e-951f-0e02bb34fe9b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:55.076474 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e17bdf9c-fed9-466e-951f-0e02bb34fe9b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:55.077355 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e17bdf9c-fed9-466e-951f-0e02bb34fe9b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:55.077886 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e17bdf9c-fed9-466e-951f-0e02bb34fe9b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:55.081690 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:55.081690 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:55.358442 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-67d6b1a0-7ec8-4d0e-84c9-5613700095c6 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:55.361009 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:55.361009 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:55.369936 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-67d6b1a0-7ec8-4d0e-84c9-5613700095c6 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1566 microversion: 2.1 time: 0.347748 Jul 13 02:29:55.370533 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 243/487] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:55 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1566 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:55.422891 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-e17bdf9c-fed9-466e-951f-0e02bb34fe9b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:55.426087 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:55.426087 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:55.435862 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-e17bdf9c-fed9-466e-951f-0e02bb34fe9b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:55.437839 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-e17bdf9c-fed9-466e-951f-0e02bb34fe9b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:55.439205 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-e17bdf9c-fed9-466e-951f-0e02bb34fe9b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1752 microversion: 2.20 time: 0.375021 Jul 13 02:29:55.439854 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 245/488] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:29:55 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1752 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:29:55.771504 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-bfa55c8e-59ae-496c-afe6-1a6d9cb97bf6 req-c1693042-258f-4704-931e-07931b36415a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e522ea39-8cb0-4f4f-8346-d951228edeaf", "name": "network-vif-deleted", "tag": "1331fe83-6765-4c69-b422-419458955d3f"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:29:55.774411 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:29:55.774411 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:29:55.782497 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-bfa55c8e-59ae-496c-afe6-1a6d9cb97bf6 req-c1693042-258f-4704-931e-07931b36415a service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:55.783015 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-bfa55c8e-59ae-496c-afe6-1a6d9cb97bf6 req-c1693042-258f-4704-931e-07931b36415a service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:55.793997 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-bfa55c8e-59ae-496c-afe6-1a6d9cb97bf6 req-c1693042-258f-4704-931e-07931b36415a service nova] Creating event network-vif-deleted:1331fe83-6765-4c69-b422-419458955d3f for instance e522ea39-8cb0-4f4f-8346-d951228edeaf on hv-cinder-78102 Jul 13 02:29:55.798806 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-bfa55c8e-59ae-496c-afe6-1a6d9cb97bf6 req-c1693042-258f-4704-931e-07931b36415a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031243 Jul 13 02:29:55.799462 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 244/489] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:29:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:29:55.979699 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-12ab8d32-5a44-4d25-bf74-47af4b1fa813 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:55.980334 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-12ab8d32-5a44-4d25-bf74-47af4b1fa813 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: e522ea39-8cb0-4f4f-8346-d951228edeaf] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:55.986450 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-12ab8d32-5a44-4d25-bf74-47af4b1fa813 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:55.986949 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-12ab8d32-5a44-4d25-bf74-47af4b1fa813 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:55.987793 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-12ab8d32-5a44-4d25-bf74-47af4b1fa813 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:55.988231 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-12ab8d32-5a44-4d25-bf74-47af4b1fa813 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:55.991723 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:55.991723 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:56.093462 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-12ab8d32-5a44-4d25-bf74-47af4b1fa813 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:56.096034 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:56.096034 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:56.104134 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-12ab8d32-5a44-4d25-bf74-47af4b1fa813 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf" status: 200 len: 1472 microversion: 2.1 time: 0.128114 Jul 13 02:29:56.104722 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 246/490] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:55 2021] GET /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf => generated 1472 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:29:56.387654 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-c2ad72af-4298-40c2-bebf-24637bec4144 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:56.388616 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-c2ad72af-4298-40c2-bebf-24637bec4144 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:56.394625 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c2ad72af-4298-40c2-bebf-24637bec4144 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:56.395090 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c2ad72af-4298-40c2-bebf-24637bec4144 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:56.395898 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c2ad72af-4298-40c2-bebf-24637bec4144 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:56.396535 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c2ad72af-4298-40c2-bebf-24637bec4144 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:56.399559 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:56.399559 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:56.458992 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-1fc24a4a-107b-4a2c-ac4e-39b8c43ee52d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:56.460137 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-1fc24a4a-107b-4a2c-ac4e-39b8c43ee52d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:56.465821 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-1fc24a4a-107b-4a2c-ac4e-39b8c43ee52d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:56.466289 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-1fc24a4a-107b-4a2c-ac4e-39b8c43ee52d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:56.467046 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-1fc24a4a-107b-4a2c-ac4e-39b8c43ee52d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:56.467473 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-1fc24a4a-107b-4a2c-ac4e-39b8c43ee52d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:56.470330 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:56.470330 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:56.605296 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-c2ad72af-4298-40c2-bebf-24637bec4144 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:56.608156 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:56.608156 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:56.616185 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-c2ad72af-4298-40c2-bebf-24637bec4144 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1566 microversion: 2.1 time: 0.231901 Jul 13 02:29:56.616745 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 245/491] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:56 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1566 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:56.672003 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-1fc24a4a-107b-4a2c-ac4e-39b8c43ee52d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:56.675221 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:56.675221 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:56.685150 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-1fc24a4a-107b-4a2c-ac4e-39b8c43ee52d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:56.686702 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-1fc24a4a-107b-4a2c-ac4e-39b8c43ee52d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:56.687850 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-1fc24a4a-107b-4a2c-ac4e-39b8c43ee52d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1752 microversion: 2.20 time: 0.233030 Jul 13 02:29:56.688408 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 247/492] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:29:56 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1752 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:29:57.120828 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-99096417-0b8e-4100-affc-11a97902e161 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:57.121473 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-99096417-0b8e-4100-affc-11a97902e161 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: e522ea39-8cb0-4f4f-8346-d951228edeaf] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:57.127283 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-99096417-0b8e-4100-affc-11a97902e161 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:57.127731 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-99096417-0b8e-4100-affc-11a97902e161 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:57.128493 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-99096417-0b8e-4100-affc-11a97902e161 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:57.128927 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-99096417-0b8e-4100-affc-11a97902e161 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:57.132262 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:57.132262 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:57.235869 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-99096417-0b8e-4100-affc-11a97902e161 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:57.238487 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:57.238487 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:57.245746 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-99096417-0b8e-4100-affc-11a97902e161 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf" status: 200 len: 1302 microversion: 2.1 time: 0.128557 Jul 13 02:29:57.246343 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 246/493] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:57 2021] GET /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf => generated 1302 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:57.633417 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-160bcbb0-e5fb-4ad7-b5bc-83ac736afd59 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:57.634046 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-160bcbb0-e5fb-4ad7-b5bc-83ac736afd59 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:57.640028 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-160bcbb0-e5fb-4ad7-b5bc-83ac736afd59 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:57.640472 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-160bcbb0-e5fb-4ad7-b5bc-83ac736afd59 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:57.641220 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-160bcbb0-e5fb-4ad7-b5bc-83ac736afd59 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:57.641649 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-160bcbb0-e5fb-4ad7-b5bc-83ac736afd59 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:57.644492 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:57.644492 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:57.706398 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-fe06d7af-a714-4e65-97d0-72de4025bb0b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:57.707027 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-fe06d7af-a714-4e65-97d0-72de4025bb0b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:57.713905 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-fe06d7af-a714-4e65-97d0-72de4025bb0b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:57.714381 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-fe06d7af-a714-4e65-97d0-72de4025bb0b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:57.715178 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-fe06d7af-a714-4e65-97d0-72de4025bb0b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:57.715610 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-fe06d7af-a714-4e65-97d0-72de4025bb0b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:57.718540 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:57.718540 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:57.848556 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-160bcbb0-e5fb-4ad7-b5bc-83ac736afd59 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:57.851475 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:57.851475 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:57.860140 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-160bcbb0-e5fb-4ad7-b5bc-83ac736afd59 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1566 microversion: 2.1 time: 0.231093 Jul 13 02:29:57.860863 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 248/494] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:57 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1566 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:57.911620 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-fe06d7af-a714-4e65-97d0-72de4025bb0b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:57.914303 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:57.914303 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:57.922173 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-fe06d7af-a714-4e65-97d0-72de4025bb0b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:57.923683 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-fe06d7af-a714-4e65-97d0-72de4025bb0b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:57.924812 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-fe06d7af-a714-4e65-97d0-72de4025bb0b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1752 microversion: 2.20 time: 0.222128 Jul 13 02:29:57.925356 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 247/495] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:29:57 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1752 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:29:58.263558 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-edd21a54-f996-44c3-b6a4-53e7066c5c9c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:58.264196 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-edd21a54-f996-44c3-b6a4-53e7066c5c9c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: e522ea39-8cb0-4f4f-8346-d951228edeaf] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:58.273153 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-edd21a54-f996-44c3-b6a4-53e7066c5c9c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:58.273673 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-edd21a54-f996-44c3-b6a4-53e7066c5c9c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:58.274503 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-edd21a54-f996-44c3-b6a4-53e7066c5c9c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:58.274945 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-edd21a54-f996-44c3-b6a4-53e7066c5c9c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:58.278818 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:58.278818 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:58.349233 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-edd21a54-f996-44c3-b6a4-53e7066c5c9c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:58.350227 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-edd21a54-f996-44c3-b6a4-53e7066c5c9c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:58.350684 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.objects.instance [None req-edd21a54-f996-44c3-b6a4-53e7066c5c9c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lazy-loading 'fault' on Instance uuid e522ea39-8cb0-4f4f-8346-d951228edeaf {{(pid=107263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 13 02:29:58.352717 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:4002: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:58.352717 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: for row in query: Jul 13 02:29:58.396520 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-edd21a54-f996-44c3-b6a4-53e7066c5c9c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:58.399545 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:58.399545 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:58.407838 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-edd21a54-f996-44c3-b6a4-53e7066c5c9c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf" status: 200 len: 1307 microversion: 2.1 time: 0.148592 Jul 13 02:29:58.408783 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 249/496] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:58 2021] GET /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf => generated 1307 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:58.877492 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-3c9f2dfa-d7ef-400c-ac45-63976e7b076c tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:58.878163 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-3c9f2dfa-d7ef-400c-ac45-63976e7b076c tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:58.885897 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3c9f2dfa-d7ef-400c-ac45-63976e7b076c tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:58.886371 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3c9f2dfa-d7ef-400c-ac45-63976e7b076c tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:58.887132 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3c9f2dfa-d7ef-400c-ac45-63976e7b076c tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:58.887559 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3c9f2dfa-d7ef-400c-ac45-63976e7b076c tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:58.890864 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:58.890864 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:58.944334 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-2612c625-209a-4048-8437-d2128e597949 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:58.945018 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-2612c625-209a-4048-8437-d2128e597949 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:58.951995 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2612c625-209a-4048-8437-d2128e597949 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:58.952451 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2612c625-209a-4048-8437-d2128e597949 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:58.954705 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2612c625-209a-4048-8437-d2128e597949 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:58.955149 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2612c625-209a-4048-8437-d2128e597949 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:58.958912 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:58.958912 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:59.101378 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-3c9f2dfa-d7ef-400c-ac45-63976e7b076c tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:59.104735 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:59.104735 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:59.114192 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-3c9f2dfa-d7ef-400c-ac45-63976e7b076c tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1566 microversion: 2.1 time: 0.240194 Jul 13 02:29:59.114905 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 248/497] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:58 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1566 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:29:59.178860 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-2612c625-209a-4048-8437-d2128e597949 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:59.181528 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:59.181528 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:29:59.189460 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-2612c625-209a-4048-8437-d2128e597949 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:59.190973 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-2612c625-209a-4048-8437-d2128e597949 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:29:59.192095 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-2612c625-209a-4048-8437-d2128e597949 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1754 microversion: 2.20 time: 0.252402 Jul 13 02:29:59.192653 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 250/498] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:29:58 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1754 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:29:59.424834 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-71f185c0-51b3-48f6-afeb-7b0e86cf2e41 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:29:59.425483 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-71f185c0-51b3-48f6-afeb-7b0e86cf2e41 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: e522ea39-8cb0-4f4f-8346-d951228edeaf] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:29:59.431724 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-71f185c0-51b3-48f6-afeb-7b0e86cf2e41 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:59.432164 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-71f185c0-51b3-48f6-afeb-7b0e86cf2e41 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:59.432923 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-71f185c0-51b3-48f6-afeb-7b0e86cf2e41 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:29:59.433354 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-71f185c0-51b3-48f6-afeb-7b0e86cf2e41 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:29:59.436165 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:29:59.436165 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:29:59.481601 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.wsgi [None req-71f185c0-51b3-48f6-afeb-7b0e86cf2e41 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] HTTP exception thrown: Instance e522ea39-8cb0-4f4f-8346-d951228edeaf could not be found. Jul 13 02:29:59.482136 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-71f185c0-51b3-48f6-afeb-7b0e86cf2e41 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Returning 404 to user: Instance e522ea39-8cb0-4f4f-8346-d951228edeaf could not be found. {{(pid=107262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:29:59.482991 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-71f185c0-51b3-48f6-afeb-7b0e86cf2e41 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf" status: 404 len: 111 microversion: 2.1 time: 0.061888 Jul 13 02:29:59.483535 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 249/499] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:29:59 2021] GET /compute/v2.1/servers/e522ea39-8cb0-4f4f-8346-d951228edeaf => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 02:30:00.132968 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-7a6022ea-e484-47d7-a6c8-b9842efcebdd tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:00.133575 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-7a6022ea-e484-47d7-a6c8-b9842efcebdd tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:00.139787 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7a6022ea-e484-47d7-a6c8-b9842efcebdd tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:00.140240 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7a6022ea-e484-47d7-a6c8-b9842efcebdd tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:00.141018 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7a6022ea-e484-47d7-a6c8-b9842efcebdd tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:00.141449 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7a6022ea-e484-47d7-a6c8-b9842efcebdd tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:00.144431 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:00.144431 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:00.211089 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-69a60c72-b60d-4011-bd0c-839cff60534d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:00.212521 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-69a60c72-b60d-4011-bd0c-839cff60534d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:00.219161 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-69a60c72-b60d-4011-bd0c-839cff60534d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:00.219931 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-69a60c72-b60d-4011-bd0c-839cff60534d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:00.221089 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-69a60c72-b60d-4011-bd0c-839cff60534d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:00.221661 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-69a60c72-b60d-4011-bd0c-839cff60534d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:00.227105 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:00.227105 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:00.608678 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-7a6022ea-e484-47d7-a6c8-b9842efcebdd tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:00.612097 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:00.612097 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:00.626927 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-7a6022ea-e484-47d7-a6c8-b9842efcebdd tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1566 microversion: 2.1 time: 0.498086 Jul 13 02:30:00.629525 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 251/500] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:00 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1566 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:00.642481 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [req-ee4e75e4-4997-4149-86ed-179d7df8b6ac req-613b163f-9b22-4f74-8b4b-3a3e0a673686 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "872b8d83-fdcf-4888-b1d3-64f49541426d", "name": "network-vif-unplugged", "status": "completed", "tag": "49588aa8-e16a-42d4-9d7e-8c1cf67a6211"}]} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:30:00.650402 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-69a60c72-b60d-4011-bd0c-839cff60534d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:00.652985 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:00.652985 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:00.655425 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:30:00.655425 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: warnings.warn(msg) Jul 13 02:30:00.662408 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-69a60c72-b60d-4011-bd0c-839cff60534d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:00.663875 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-69a60c72-b60d-4011-bd0c-839cff60534d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:00.665439 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-69a60c72-b60d-4011-bd0c-839cff60534d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1810 microversion: 2.20 time: 0.459138 Jul 13 02:30:00.666269 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-ee4e75e4-4997-4149-86ed-179d7df8b6ac req-613b163f-9b22-4f74-8b4b-3a3e0a673686 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:00.677083 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 250/501] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:30:00 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1810 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:30:00.677083 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-9aebfee8-69aa-40af-ac48-8403e0e0794c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:00.677083 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-9aebfee8-69aa-40af-ac48-8403e0e0794c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: 55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:00.679462 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-ee4e75e4-4997-4149-86ed-179d7df8b6ac req-613b163f-9b22-4f74-8b4b-3a3e0a673686 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:00.679688 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9aebfee8-69aa-40af-ac48-8403e0e0794c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:00.680154 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9aebfee8-69aa-40af-ac48-8403e0e0794c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:00.680929 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9aebfee8-69aa-40af-ac48-8403e0e0794c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:00.681532 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9aebfee8-69aa-40af-ac48-8403e0e0794c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:00.685940 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:00.685940 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:00.702695 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.compute.server_external_events [req-ee4e75e4-4997-4149-86ed-179d7df8b6ac req-613b163f-9b22-4f74-8b4b-3a3e0a673686 service nova] Creating event network-vif-unplugged:49588aa8-e16a-42d4-9d7e-8c1cf67a6211 for instance 872b8d83-fdcf-4888-b1d3-64f49541426d on hv-cinder-78102 Jul 13 02:30:00.717454 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [req-ee4e75e4-4997-4149-86ed-179d7df8b6ac req-613b163f-9b22-4f74-8b4b-3a3e0a673686 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086385 Jul 13 02:30:00.719535 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 252/502] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:30:00 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:30:00.775850 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-9aebfee8-69aa-40af-ac48-8403e0e0794c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: 55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf] Going to try to terminate instance {{(pid=107262) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 13 02:30:00.778358 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3008: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:00.778358 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).\ Jul 13 02:30:00.803571 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:00.803571 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:00.882735 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/update_match.py:472: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:00.882735 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = query.session.execute(update_stmt) Jul 13 02:30:00.902367 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:530: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:00.902367 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = model_query(context, models.Service, read_deleted="no").\ Jul 13 02:30:00.951906 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-9aebfee8-69aa-40af-ac48-8403e0e0794c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "DELETE /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf" status: 204 len: 0 microversion: 2.1 time: 0.284073 Jul 13 02:30:00.952866 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 251/503] 10.222.0.32 () {58 vars in 1239 bytes} [Tue Jul 13 02:30:00 2021] DELETE /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf => generated 0 bytes in 286 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 13 02:30:00.963835 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-6c7a18ec-73b0-4b00-a831-aa363af4f099 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:00.964529 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-6c7a18ec-73b0-4b00-a831-aa363af4f099 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: 55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:00.970682 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6c7a18ec-73b0-4b00-a831-aa363af4f099 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:00.971124 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6c7a18ec-73b0-4b00-a831-aa363af4f099 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:00.971927 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6c7a18ec-73b0-4b00-a831-aa363af4f099 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:00.972355 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6c7a18ec-73b0-4b00-a831-aa363af4f099 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:00.975765 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:00.975765 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:01.154799 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-6c7a18ec-73b0-4b00-a831-aa363af4f099 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:01.157569 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:01.157569 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:01.164615 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-6c7a18ec-73b0-4b00-a831-aa363af4f099 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf" status: 200 len: 1514 microversion: 2.1 time: 0.205632 Jul 13 02:30:01.165183 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 253/504] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:00 2021] GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf => generated 1514 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:01.646988 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-e65ce668-be29-45a2-bca3-1dbb8eeedacd tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:01.647731 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-e65ce668-be29-45a2-bca3-1dbb8eeedacd tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:01.653543 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e65ce668-be29-45a2-bca3-1dbb8eeedacd tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:01.653989 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e65ce668-be29-45a2-bca3-1dbb8eeedacd tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:01.654788 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e65ce668-be29-45a2-bca3-1dbb8eeedacd tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:01.655223 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e65ce668-be29-45a2-bca3-1dbb8eeedacd tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:01.658051 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:01.658051 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:01.683473 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-5211c54e-c2c8-486f-baab-164d9a327630 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:01.685597 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-5211c54e-c2c8-486f-baab-164d9a327630 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:01.691407 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5211c54e-c2c8-486f-baab-164d9a327630 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:01.691860 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5211c54e-c2c8-486f-baab-164d9a327630 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:01.692623 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5211c54e-c2c8-486f-baab-164d9a327630 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:01.693055 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5211c54e-c2c8-486f-baab-164d9a327630 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:01.695923 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:01.695923 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:02.131355 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-e65ce668-be29-45a2-bca3-1dbb8eeedacd tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:02.134135 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:02.134135 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:02.141666 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-e65ce668-be29-45a2-bca3-1dbb8eeedacd tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1566 microversion: 2.1 time: 0.498778 Jul 13 02:30:02.142258 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 252/505] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:01 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1566 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:02.149645 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-5211c54e-c2c8-486f-baab-164d9a327630 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:02.152195 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:02.152195 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:02.159955 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-5211c54e-c2c8-486f-baab-164d9a327630 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:02.161462 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-5211c54e-c2c8-486f-baab-164d9a327630 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:02.162751 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-5211c54e-c2c8-486f-baab-164d9a327630 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1810 microversion: 2.20 time: 0.482881 Jul 13 02:30:02.163292 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 254/506] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:30:01 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1810 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:30:02.181079 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-db308564-9029-4453-b071-a7fdb2ebc7a1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:02.181680 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-db308564-9029-4453-b071-a7fdb2ebc7a1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: 55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:02.187327 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-db308564-9029-4453-b071-a7fdb2ebc7a1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:02.187761 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-db308564-9029-4453-b071-a7fdb2ebc7a1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:02.188508 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-db308564-9029-4453-b071-a7fdb2ebc7a1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:02.188933 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-db308564-9029-4453-b071-a7fdb2ebc7a1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:02.191769 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:02.191769 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:02.365863 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-db308564-9029-4453-b071-a7fdb2ebc7a1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:02.368463 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:02.368463 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:02.375187 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-db308564-9029-4453-b071-a7fdb2ebc7a1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf" status: 200 len: 1514 microversion: 2.1 time: 0.197818 Jul 13 02:30:02.375743 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 253/507] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:02 2021] GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf => generated 1514 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:02.751756 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [req-f22affaf-c108-408c-8266-a17a1a0e8e75 req-1a98ed43-0f48-47fd-8bac-c5782757482e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "872b8d83-fdcf-4888-b1d3-64f49541426d", "name": "network-vif-plugged", "status": "completed", "tag": "49588aa8-e16a-42d4-9d7e-8c1cf67a6211"}]} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:30:02.753300 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:30:02.753300 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: warnings.warn(msg) Jul 13 02:30:02.760405 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-f22affaf-c108-408c-8266-a17a1a0e8e75 req-1a98ed43-0f48-47fd-8bac-c5782757482e service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:02.760843 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-f22affaf-c108-408c-8266-a17a1a0e8e75 req-1a98ed43-0f48-47fd-8bac-c5782757482e service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:02.771942 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.compute.server_external_events [req-f22affaf-c108-408c-8266-a17a1a0e8e75 req-1a98ed43-0f48-47fd-8bac-c5782757482e service nova] Creating event network-vif-plugged:49588aa8-e16a-42d4-9d7e-8c1cf67a6211 for instance 872b8d83-fdcf-4888-b1d3-64f49541426d on hv-cinder-78102 Jul 13 02:30:02.776972 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [req-f22affaf-c108-408c-8266-a17a1a0e8e75 req-1a98ed43-0f48-47fd-8bac-c5782757482e service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028840 Jul 13 02:30:02.777522 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 255/508] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:30:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 02:30:03.159023 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-2f7dd396-d864-4d27-a92a-b5acfacd188c tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:03.159629 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-2f7dd396-d864-4d27-a92a-b5acfacd188c tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:03.165669 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2f7dd396-d864-4d27-a92a-b5acfacd188c tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:03.166151 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2f7dd396-d864-4d27-a92a-b5acfacd188c tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:03.166910 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2f7dd396-d864-4d27-a92a-b5acfacd188c tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:03.167347 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2f7dd396-d864-4d27-a92a-b5acfacd188c tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:03.170186 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:03.170186 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:03.181498 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-30a1c8c0-2296-4040-b3a3-706b147b1f5f tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:03.182302 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-30a1c8c0-2296-4040-b3a3-706b147b1f5f tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:03.188227 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-30a1c8c0-2296-4040-b3a3-706b147b1f5f tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:03.188674 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-30a1c8c0-2296-4040-b3a3-706b147b1f5f tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:03.189437 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-30a1c8c0-2296-4040-b3a3-706b147b1f5f tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:03.189873 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-30a1c8c0-2296-4040-b3a3-706b147b1f5f tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:03.192728 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:03.192728 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:03.413979 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-2f7dd396-d864-4d27-a92a-b5acfacd188c tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:03.416563 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-30a1c8c0-2296-4040-b3a3-706b147b1f5f tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:03.416696 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:03.416696 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:03.419318 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:03.419318 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:03.423918 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-2f7dd396-d864-4d27-a92a-b5acfacd188c tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1566 microversion: 2.1 time: 0.268552 Jul 13 02:30:03.430855 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 254/509] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:03 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1566 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:03.431037 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-30a1c8c0-2296-4040-b3a3-706b147b1f5f tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:03.431140 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-f43a83bf-0a07-437f-b7fe-fe34e2b46512 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:03.431219 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-30a1c8c0-2296-4040-b3a3-706b147b1f5f tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:03.431303 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-f43a83bf-0a07-437f-b7fe-fe34e2b46512 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: 55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:03.431393 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-30a1c8c0-2296-4040-b3a3-706b147b1f5f tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1810 microversion: 2.20 time: 0.253920 Jul 13 02:30:03.432019 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 256/510] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:30:03 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1810 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:30:03.436003 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f43a83bf-0a07-437f-b7fe-fe34e2b46512 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:03.436445 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f43a83bf-0a07-437f-b7fe-fe34e2b46512 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:03.437209 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f43a83bf-0a07-437f-b7fe-fe34e2b46512 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:03.437639 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f43a83bf-0a07-437f-b7fe-fe34e2b46512 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:03.440455 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:03.440455 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:03.614966 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-f43a83bf-0a07-437f-b7fe-fe34e2b46512 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:03.618231 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:03.618231 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:03.624977 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-f43a83bf-0a07-437f-b7fe-fe34e2b46512 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf" status: 200 len: 1514 microversion: 2.1 time: 0.199553 Jul 13 02:30:03.625546 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 255/511] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:03 2021] GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf => generated 1514 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:04.441824 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-b01bc050-648e-47aa-9bac-bf7b6d147459 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:04.442631 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-b01bc050-648e-47aa-9bac-bf7b6d147459 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:04.448797 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-0dbd4175-6875-4283-a27c-ea9f08ee9877 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:04.449405 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-0dbd4175-6875-4283-a27c-ea9f08ee9877 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:04.449609 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b01bc050-648e-47aa-9bac-bf7b6d147459 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:04.450077 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b01bc050-648e-47aa-9bac-bf7b6d147459 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:04.451048 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b01bc050-648e-47aa-9bac-bf7b6d147459 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:04.451477 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b01bc050-648e-47aa-9bac-bf7b6d147459 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:04.454398 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:04.454398 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:04.455604 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-0dbd4175-6875-4283-a27c-ea9f08ee9877 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:04.456075 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-0dbd4175-6875-4283-a27c-ea9f08ee9877 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:04.456824 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-0dbd4175-6875-4283-a27c-ea9f08ee9877 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:04.457258 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-0dbd4175-6875-4283-a27c-ea9f08ee9877 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:04.460192 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:04.460192 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:04.709132 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-b01bc050-648e-47aa-9bac-bf7b6d147459 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:04.712909 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:04.712909 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:04.728480 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-0dbd4175-6875-4283-a27c-ea9f08ee9877 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:04.728706 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-b01bc050-648e-47aa-9bac-bf7b6d147459 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1566 microversion: 2.1 time: 0.290299 Jul 13 02:30:04.731553 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 257/512] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:04 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1566 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:30:04.731725 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:04.731725 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:04.740254 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-490697b6-f6ec-4cec-9e79-3ab3acf3040b tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:04.740997 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-0dbd4175-6875-4283-a27c-ea9f08ee9877 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:04.742950 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-0dbd4175-6875-4283-a27c-ea9f08ee9877 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:04.744648 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-0dbd4175-6875-4283-a27c-ea9f08ee9877 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1810 microversion: 2.20 time: 0.299513 Jul 13 02:30:04.746623 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-490697b6-f6ec-4cec-9e79-3ab3acf3040b tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: 55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:04.755580 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 256/513] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:30:04 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1810 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:30:04.758488 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-490697b6-f6ec-4cec-9e79-3ab3acf3040b tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:04.759119 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-490697b6-f6ec-4cec-9e79-3ab3acf3040b tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:04.760061 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-490697b6-f6ec-4cec-9e79-3ab3acf3040b tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:04.760660 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-490697b6-f6ec-4cec-9e79-3ab3acf3040b tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:04.763748 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-06e27be7-ab2f-4c98-b49a-1b58787618c1 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-865851114", "imageRef": "1a3efd47-3618-4abd-b00b-a9fa9b90b4d4", "flavorRef": "452", "networks": [{"uuid": "889ba6c6-2035-4ca1-b73e-b7767234c4d9"}]}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:30:04.764552 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:04.764552 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:04.822837 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.network.neutron [None req-06e27be7-ab2f-4c98-b49a-1b58787618c1 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] validate_networks() for [('889ba6c6-2035-4ca1-b73e-b7767234c4d9', None, None, None)] {{(pid=107262) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Jul 13 02:30:05.035961 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-490697b6-f6ec-4cec-9e79-3ab3acf3040b tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:05.039175 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:05.039175 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:05.046206 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-490697b6-f6ec-4cec-9e79-3ab3acf3040b tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf" status: 200 len: 1514 microversion: 2.1 time: 0.313223 Jul 13 02:30:05.046781 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 258/514] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:04 2021] GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf => generated 1514 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:05.252575 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-06e27be7-ab2f-4c98-b49a-1b58787618c1 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Flavor limits 0:0:0 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 02:30:05.252994 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-06e27be7-ab2f-4c98-b49a-1b58787618c1 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Image limits 0:0:0 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 02:30:05.253489 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-06e27be7-ab2f-4c98-b49a-1b58787618c1 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Flavor pref 0:0:0 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 02:30:05.253919 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-06e27be7-ab2f-4c98-b49a-1b58787618c1 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Image pref 0:0:0 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 02:30:05.254353 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-06e27be7-ab2f-4c98-b49a-1b58787618c1 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 02:30:05.260744 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2690: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:05.260744 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: user_quotas = model_query(context, models.ProjectUserQuota, Jul 13 02:30:05.264977 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-06e27be7-ab2f-4c98-b49a-1b58787618c1 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:05.265416 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-06e27be7-ab2f-4c98-b49a-1b58787618c1 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:05.266251 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-06e27be7-ab2f-4c98-b49a-1b58787618c1 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:05.266682 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-06e27be7-ab2f-4c98-b49a-1b58787618c1 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:05.273362 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/objects/instance.py:1537: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:05.273362 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: project_result = project_query.first() Jul 13 02:30:05.285357 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2708: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:05.285357 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: rows = model_query(context, models.Quota, read_deleted="no").\ Jul 13 02:30:05.289542 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.quota [None req-06e27be7-ab2f-4c98-b49a-1b58787618c1 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Getting quotas for project eaa2c1d46685432e8656123be9d86664. Resources: {'ram', 'cores', 'instances'} {{(pid=107262) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 13 02:30:05.293436 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.quota [None req-06e27be7-ab2f-4c98-b49a-1b58787618c1 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Getting quotas for user 21025e2c8aa9423dbd05da95f237b481 and project eaa2c1d46685432e8656123be9d86664. Resources: {'ram', 'cores', 'instances'} {{(pid=107262) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 13 02:30:05.304779 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-06e27be7-ab2f-4c98-b49a-1b58787618c1 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Going to run 1 instances... {{(pid=107262) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 13 02:30:05.307080 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-06e27be7-ab2f-4c98-b49a-1b58787618c1 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 325ba981-747f-4908-a6d4-529a36297483] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a3efd47-3618-4abd-b00b-a9fa9b90b4d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107262) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 13 02:30:05.352203 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-06e27be7-ab2f-4c98-b49a-1b58787618c1 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.594409 Jul 13 02:30:05.353103 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 257/515] 10.222.0.32 () {60 vars in 1147 bytes} [Tue Jul 13 02:30:04 2021] POST /compute/v2.1/servers => generated 380 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 02:30:05.363061 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-eb958416-976f-4802-90bd-02ac37b670fb tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:05.363804 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-eb958416-976f-4802-90bd-02ac37b670fb tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 325ba981-747f-4908-a6d4-529a36297483] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:05.421212 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-eb958416-976f-4802-90bd-02ac37b670fb tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21025e2c8aa9423dbd05da95f237b481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2c1d46685432e8656123be9d86664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:05.424332 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:05.424332 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:05.431943 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-eb958416-976f-4802-90bd-02ac37b670fb tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "GET /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483" status: 200 len: 1218 microversion: 2.1 time: 0.072516 Jul 13 02:30:05.432794 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 259/516] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:05 2021] GET /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483 => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:05.745211 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-22f05139-e5ef-4716-bf31-a7b4202b9ba8 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:05.745727 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-22f05139-e5ef-4716-bf31-a7b4202b9ba8 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:05.755039 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-22f05139-e5ef-4716-bf31-a7b4202b9ba8 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:05.755484 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-22f05139-e5ef-4716-bf31-a7b4202b9ba8 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:05.757512 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-22f05139-e5ef-4716-bf31-a7b4202b9ba8 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:05.757948 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-22f05139-e5ef-4716-bf31-a7b4202b9ba8 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:05.762565 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:05.762565 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:05.768847 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-e234da11-8069-458b-9197-bf97d42faa42 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:05.769461 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-e234da11-8069-458b-9197-bf97d42faa42 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:05.790996 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e234da11-8069-458b-9197-bf97d42faa42 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:05.791740 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e234da11-8069-458b-9197-bf97d42faa42 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:05.792706 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e234da11-8069-458b-9197-bf97d42faa42 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:05.793306 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e234da11-8069-458b-9197-bf97d42faa42 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:05.796722 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:05.796722 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:06.043139 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-e234da11-8069-458b-9197-bf97d42faa42 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:06.044935 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-22f05139-e5ef-4716-bf31-a7b4202b9ba8 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:06.047690 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:06.047690 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:06.051647 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:06.051647 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:06.057714 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-22f05139-e5ef-4716-bf31-a7b4202b9ba8 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1566 microversion: 2.1 time: 0.314975 Jul 13 02:30:06.057714 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 258/517] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:05 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1566 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:06.074386 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-296021da-0c78-42bd-a4b9-f86e2d6773a1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:06.075335 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-e234da11-8069-458b-9197-bf97d42faa42 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:06.075539 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-296021da-0c78-42bd-a4b9-f86e2d6773a1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: 55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:06.081336 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-e234da11-8069-458b-9197-bf97d42faa42 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:06.082756 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-e234da11-8069-458b-9197-bf97d42faa42 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1810 microversion: 2.20 time: 0.317741 Jul 13 02:30:06.083490 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-296021da-0c78-42bd-a4b9-f86e2d6773a1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:06.084925 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-296021da-0c78-42bd-a4b9-f86e2d6773a1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:06.086095 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-296021da-0c78-42bd-a4b9-f86e2d6773a1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:06.086974 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-296021da-0c78-42bd-a4b9-f86e2d6773a1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:06.090182 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 260/518] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:30:05 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1810 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:30:06.096528 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:06.096528 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:06.277077 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-296021da-0c78-42bd-a4b9-f86e2d6773a1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:06.279620 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:06.279620 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:06.286342 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-296021da-0c78-42bd-a4b9-f86e2d6773a1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf" status: 200 len: 1514 microversion: 2.1 time: 0.217187 Jul 13 02:30:06.287408 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 259/519] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:06 2021] GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf => generated 1514 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:06.449004 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-fdbcccea-be91-4a27-935f-a409048c5caa tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:06.449609 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-fdbcccea-be91-4a27-935f-a409048c5caa tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 325ba981-747f-4908-a6d4-529a36297483] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:06.457070 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-fdbcccea-be91-4a27-935f-a409048c5caa tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:06.457466 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-fdbcccea-be91-4a27-935f-a409048c5caa tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:06.458705 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-fdbcccea-be91-4a27-935f-a409048c5caa tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:06.459248 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-fdbcccea-be91-4a27-935f-a409048c5caa tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:06.463026 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:06.463026 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:06.605572 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-fdbcccea-be91-4a27-935f-a409048c5caa tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21025e2c8aa9423dbd05da95f237b481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2c1d46685432e8656123be9d86664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:06.608304 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:06.608304 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:06.615555 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-fdbcccea-be91-4a27-935f-a409048c5caa tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "GET /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483" status: 200 len: 1222 microversion: 2.1 time: 0.170010 Jul 13 02:30:06.619038 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 261/520] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:06 2021] GET /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483 => generated 1222 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:07.073386 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-3be98505-92a2-4dde-b571-57a4c3dec4e7 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:07.074001 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-3be98505-92a2-4dde-b571-57a4c3dec4e7 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:07.080061 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3be98505-92a2-4dde-b571-57a4c3dec4e7 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:07.080508 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3be98505-92a2-4dde-b571-57a4c3dec4e7 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:07.081334 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3be98505-92a2-4dde-b571-57a4c3dec4e7 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:07.081794 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3be98505-92a2-4dde-b571-57a4c3dec4e7 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:07.084807 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:07.084807 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:07.104227 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-c4dc7640-9c74-4e96-929e-0e0beef3b2a6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:07.104870 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-c4dc7640-9c74-4e96-929e-0e0beef3b2a6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:07.111206 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c4dc7640-9c74-4e96-929e-0e0beef3b2a6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:07.111667 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c4dc7640-9c74-4e96-929e-0e0beef3b2a6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:07.112457 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c4dc7640-9c74-4e96-929e-0e0beef3b2a6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:07.112874 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c4dc7640-9c74-4e96-929e-0e0beef3b2a6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:07.117445 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:07.117445 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:07.353930 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-3be98505-92a2-4dde-b571-57a4c3dec4e7 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:07.357216 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:07.357216 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:07.364702 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-3be98505-92a2-4dde-b571-57a4c3dec4e7 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1566 microversion: 2.1 time: 0.295061 Jul 13 02:30:07.365892 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 260/521] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:07 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1566 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:07.375029 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-a87fc88c-297e-4de2-b3d0-69424be5cf51 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:07.375924 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-a87fc88c-297e-4de2-b3d0-69424be5cf51 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: 55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:07.387441 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a87fc88c-297e-4de2-b3d0-69424be5cf51 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:07.388500 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a87fc88c-297e-4de2-b3d0-69424be5cf51 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:07.389419 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a87fc88c-297e-4de2-b3d0-69424be5cf51 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:07.390050 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a87fc88c-297e-4de2-b3d0-69424be5cf51 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:07.393559 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:07.393559 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:07.395721 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-c4dc7640-9c74-4e96-929e-0e0beef3b2a6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:07.400333 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:07.400333 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:07.409902 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-c4dc7640-9c74-4e96-929e-0e0beef3b2a6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:07.411438 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-c4dc7640-9c74-4e96-929e-0e0beef3b2a6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:07.412854 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-c4dc7640-9c74-4e96-929e-0e0beef3b2a6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1810 microversion: 2.20 time: 0.313549 Jul 13 02:30:07.413490 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 262/522] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:30:07 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1810 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:30:07.581454 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-a87fc88c-297e-4de2-b3d0-69424be5cf51 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:07.587347 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:07.587347 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:07.597100 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-a87fc88c-297e-4de2-b3d0-69424be5cf51 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf" status: 200 len: 1514 microversion: 2.1 time: 0.225939 Jul 13 02:30:07.597616 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 261/523] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:07 2021] GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf => generated 1514 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:07.632770 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-8cf48014-692d-44a6-942a-5c52bc92a32d tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:07.633377 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-8cf48014-692d-44a6-942a-5c52bc92a32d tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 325ba981-747f-4908-a6d4-529a36297483] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:07.639514 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8cf48014-692d-44a6-942a-5c52bc92a32d tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:07.639956 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8cf48014-692d-44a6-942a-5c52bc92a32d tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:07.640711 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8cf48014-692d-44a6-942a-5c52bc92a32d tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:07.641138 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8cf48014-692d-44a6-942a-5c52bc92a32d tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:07.643987 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:07.643987 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:07.753223 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-8cf48014-692d-44a6-942a-5c52bc92a32d tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21025e2c8aa9423dbd05da95f237b481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2c1d46685432e8656123be9d86664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:07.756626 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:07.756626 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:07.765644 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-8cf48014-692d-44a6-942a-5c52bc92a32d tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "GET /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483" status: 200 len: 1222 microversion: 2.1 time: 0.136876 Jul 13 02:30:07.769863 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 263/524] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:07 2021] GET /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483 => generated 1222 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:08.382106 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-59170125-9c1f-4daf-9247-663c080b33e2 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:08.382781 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-59170125-9c1f-4daf-9247-663c080b33e2 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:08.388807 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-59170125-9c1f-4daf-9247-663c080b33e2 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:08.389252 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-59170125-9c1f-4daf-9247-663c080b33e2 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:08.390015 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-59170125-9c1f-4daf-9247-663c080b33e2 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:08.390463 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-59170125-9c1f-4daf-9247-663c080b33e2 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:08.393290 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:08.393290 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:08.432845 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-26bfc4ec-e0f9-4a22-b2a0-5ba7cb70a480 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:08.433455 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-26bfc4ec-e0f9-4a22-b2a0-5ba7cb70a480 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:08.439566 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-26bfc4ec-e0f9-4a22-b2a0-5ba7cb70a480 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:08.440094 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-26bfc4ec-e0f9-4a22-b2a0-5ba7cb70a480 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:08.440938 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-26bfc4ec-e0f9-4a22-b2a0-5ba7cb70a480 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:08.441593 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-26bfc4ec-e0f9-4a22-b2a0-5ba7cb70a480 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:08.445609 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:08.445609 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:08.647843 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-59170125-9c1f-4daf-9247-663c080b33e2 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:08.650699 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:08.650699 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:08.658361 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-59170125-9c1f-4daf-9247-663c080b33e2 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1566 microversion: 2.1 time: 0.280661 Jul 13 02:30:08.658933 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 262/525] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:08 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1566 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:08.663338 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-d3011f3a-815e-49ed-8cff-db2d84ff855e tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:08.664074 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-d3011f3a-815e-49ed-8cff-db2d84ff855e tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: 55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:08.670161 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d3011f3a-815e-49ed-8cff-db2d84ff855e tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:08.670746 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d3011f3a-815e-49ed-8cff-db2d84ff855e tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:08.671515 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d3011f3a-815e-49ed-8cff-db2d84ff855e tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:08.671943 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d3011f3a-815e-49ed-8cff-db2d84ff855e tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:08.673038 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-26bfc4ec-e0f9-4a22-b2a0-5ba7cb70a480 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:08.674987 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:08.674987 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:08.675618 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:08.675618 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:08.683546 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-26bfc4ec-e0f9-4a22-b2a0-5ba7cb70a480 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:08.685153 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-26bfc4ec-e0f9-4a22-b2a0-5ba7cb70a480 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:08.687284 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-26bfc4ec-e0f9-4a22-b2a0-5ba7cb70a480 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1810 microversion: 2.20 time: 0.258331 Jul 13 02:30:08.688390 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 264/526] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:30:08 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1810 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:30:08.782791 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-eb7bdbf9-93ab-43ff-ab8d-53dadeb53d94 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:08.783514 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-eb7bdbf9-93ab-43ff-ab8d-53dadeb53d94 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 325ba981-747f-4908-a6d4-529a36297483] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:08.790720 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-eb7bdbf9-93ab-43ff-ab8d-53dadeb53d94 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:08.791164 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-eb7bdbf9-93ab-43ff-ab8d-53dadeb53d94 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:08.792015 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-eb7bdbf9-93ab-43ff-ab8d-53dadeb53d94 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:08.792361 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-eb7bdbf9-93ab-43ff-ab8d-53dadeb53d94 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:08.795542 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:08.795542 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:08.858527 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-d3011f3a-815e-49ed-8cff-db2d84ff855e tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:08.861151 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:08.861151 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:08.868267 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-d3011f3a-815e-49ed-8cff-db2d84ff855e tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf" status: 200 len: 1514 microversion: 2.1 time: 0.208364 Jul 13 02:30:08.868838 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 263/527] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:08 2021] GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf => generated 1514 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:08.901891 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-eb7bdbf9-93ab-43ff-ab8d-53dadeb53d94 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21025e2c8aa9423dbd05da95f237b481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2c1d46685432e8656123be9d86664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:08.907685 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:08.907685 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:08.916441 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-eb7bdbf9-93ab-43ff-ab8d-53dadeb53d94 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "GET /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483" status: 200 len: 1222 microversion: 2.1 time: 0.137150 Jul 13 02:30:08.926131 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 265/528] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:08 2021] GET /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483 => generated 1222 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:30:09.675536 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-ac302dcd-b63f-41b4-b692-2b29d4664d26 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:09.676170 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-ac302dcd-b63f-41b4-b692-2b29d4664d26 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:09.682136 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ac302dcd-b63f-41b4-b692-2b29d4664d26 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:09.682583 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ac302dcd-b63f-41b4-b692-2b29d4664d26 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:09.683348 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ac302dcd-b63f-41b4-b692-2b29d4664d26 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:09.683781 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ac302dcd-b63f-41b4-b692-2b29d4664d26 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:09.686648 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:09.686648 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:09.705492 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-d991c47a-894b-4513-bad0-3decb127d4e7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:09.706121 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-d991c47a-894b-4513-bad0-3decb127d4e7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:09.712784 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d991c47a-894b-4513-bad0-3decb127d4e7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:09.713230 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d991c47a-894b-4513-bad0-3decb127d4e7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:09.713996 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d991c47a-894b-4513-bad0-3decb127d4e7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:09.714451 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d991c47a-894b-4513-bad0-3decb127d4e7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:09.717302 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:09.717302 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:09.940525 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-ac302dcd-b63f-41b4-b692-2b29d4664d26 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:09.944096 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-d991c47a-894b-4513-bad0-3decb127d4e7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:09.944348 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:09.944348 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:09.946660 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:09.946660 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:09.957921 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-d991c47a-894b-4513-bad0-3decb127d4e7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:09.958178 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-ac302dcd-b63f-41b4-b692-2b29d4664d26 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1566 microversion: 2.1 time: 0.286095 Jul 13 02:30:09.960497 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-d991c47a-894b-4513-bad0-3decb127d4e7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:09.961682 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-d991c47a-894b-4513-bad0-3decb127d4e7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1810 microversion: 2.20 time: 0.259793 Jul 13 02:30:09.967085 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 264/529] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:09 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1566 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:09.970491 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 266/530] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:30:09 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1810 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:30:09.972080 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-c85a245b-e19e-423f-a6b0-b9f00119c0cf tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:09.972758 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-c85a245b-e19e-423f-a6b0-b9f00119c0cf tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: 55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:09.975277 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-c06b3990-5455-40e2-a554-6c9d00060b22 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:09.975900 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-c06b3990-5455-40e2-a554-6c9d00060b22 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 325ba981-747f-4908-a6d4-529a36297483] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:09.979938 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c85a245b-e19e-423f-a6b0-b9f00119c0cf tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:09.980388 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c85a245b-e19e-423f-a6b0-b9f00119c0cf tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:09.981160 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c85a245b-e19e-423f-a6b0-b9f00119c0cf tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:09.981586 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c85a245b-e19e-423f-a6b0-b9f00119c0cf tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:09.981722 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c06b3990-5455-40e2-a554-6c9d00060b22 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:09.982477 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c06b3990-5455-40e2-a554-6c9d00060b22 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:09.984257 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c06b3990-5455-40e2-a554-6c9d00060b22 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:09.984535 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c06b3990-5455-40e2-a554-6c9d00060b22 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:09.986992 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:09.986992 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:09.988003 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:09.988003 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:10.110685 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-c06b3990-5455-40e2-a554-6c9d00060b22 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21025e2c8aa9423dbd05da95f237b481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2c1d46685432e8656123be9d86664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:10.113263 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:10.113263 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:10.120258 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-c06b3990-5455-40e2-a554-6c9d00060b22 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "GET /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483" status: 200 len: 1222 microversion: 2.1 time: 0.148726 Jul 13 02:30:10.120826 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 267/531] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:09 2021] GET /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483 => generated 1222 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:10.189920 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-c85a245b-e19e-423f-a6b0-b9f00119c0cf tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:10.192512 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:10.192512 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:10.203052 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-c85a245b-e19e-423f-a6b0-b9f00119c0cf tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf" status: 200 len: 1514 microversion: 2.1 time: 0.234684 Jul 13 02:30:10.205211 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 265/532] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:09 2021] GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf => generated 1514 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:10.976300 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-ffba1c0c-c49c-4144-a430-43e574027ba8 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:10.979066 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-ffba1c0c-c49c-4144-a430-43e574027ba8 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:10.979583 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-00d7ec5f-f438-4456-915a-70a37265611e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:10.980198 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-00d7ec5f-f438-4456-915a-70a37265611e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:10.986437 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-00d7ec5f-f438-4456-915a-70a37265611e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:10.986897 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-00d7ec5f-f438-4456-915a-70a37265611e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:10.987546 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ffba1c0c-c49c-4144-a430-43e574027ba8 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:10.987691 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-00d7ec5f-f438-4456-915a-70a37265611e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:10.988101 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-00d7ec5f-f438-4456-915a-70a37265611e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:10.988469 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ffba1c0c-c49c-4144-a430-43e574027ba8 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:10.991642 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ffba1c0c-c49c-4144-a430-43e574027ba8 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:10.992585 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ffba1c0c-c49c-4144-a430-43e574027ba8 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:10.992907 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:10.992907 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:10.997616 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:10.997616 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:11.304335 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-00d7ec5f-f438-4456-915a-70a37265611e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:11.307638 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:11.307638 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:11.312998 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-ffba1c0c-c49c-4144-a430-43e574027ba8 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:11.315915 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:11.315915 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:11.324280 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-00d7ec5f-f438-4456-915a-70a37265611e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:11.326041 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-00d7ec5f-f438-4456-915a-70a37265611e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:11.328269 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-00d7ec5f-f438-4456-915a-70a37265611e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1810 microversion: 2.20 time: 0.352387 Jul 13 02:30:11.343025 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 266/533] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:30:10 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1810 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:30:11.346959 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-ffba1c0c-c49c-4144-a430-43e574027ba8 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1566 microversion: 2.1 time: 0.374923 Jul 13 02:30:11.348504 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-1b01a020-cac2-48ed-a142-9e377b8d5592 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:11.349340 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-1b01a020-cac2-48ed-a142-9e377b8d5592 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 325ba981-747f-4908-a6d4-529a36297483] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:11.351182 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 268/534] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:10 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1566 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:11.365578 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1b01a020-cac2-48ed-a142-9e377b8d5592 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:11.366322 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1b01a020-cac2-48ed-a142-9e377b8d5592 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:11.367353 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1b01a020-cac2-48ed-a142-9e377b8d5592 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:11.367944 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1b01a020-cac2-48ed-a142-9e377b8d5592 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:11.368070 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-9a7593e5-0966-4d84-a20a-452e97c5a5ce tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:11.369617 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-9a7593e5-0966-4d84-a20a-452e97c5a5ce tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: 55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:11.371867 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:11.371867 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:11.393149 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-9a7593e5-0966-4d84-a20a-452e97c5a5ce tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:11.398453 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-9a7593e5-0966-4d84-a20a-452e97c5a5ce tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:11.401670 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-9a7593e5-0966-4d84-a20a-452e97c5a5ce tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:11.406573 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-9a7593e5-0966-4d84-a20a-452e97c5a5ce tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:11.420061 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:11.420061 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:11.523877 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-1b01a020-cac2-48ed-a142-9e377b8d5592 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21025e2c8aa9423dbd05da95f237b481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2c1d46685432e8656123be9d86664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:11.527464 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:11.527464 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:11.539613 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-1b01a020-cac2-48ed-a142-9e377b8d5592 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "GET /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483" status: 200 len: 1222 microversion: 2.1 time: 0.194843 Jul 13 02:30:11.541079 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 267/535] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:11 2021] GET /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483 => generated 1222 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:11.709983 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-9a7593e5-0966-4d84-a20a-452e97c5a5ce tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:11.713311 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:11.713311 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:11.732452 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-9a7593e5-0966-4d84-a20a-452e97c5a5ce tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf" status: 200 len: 1514 microversion: 2.1 time: 0.378200 Jul 13 02:30:11.733454 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 269/536] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:11 2021] GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf => generated 1514 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:12.349208 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-d03bdc89-40dc-4e44-8e26-2c04ad157729 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:12.351813 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-d03bdc89-40dc-4e44-8e26-2c04ad157729 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:12.369170 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-d6bdadab-efdd-419b-a780-3b4780dffb00 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:12.369784 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-d6bdadab-efdd-419b-a780-3b4780dffb00 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:12.377203 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d03bdc89-40dc-4e44-8e26-2c04ad157729 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:12.379382 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d6bdadab-efdd-419b-a780-3b4780dffb00 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:12.379820 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d6bdadab-efdd-419b-a780-3b4780dffb00 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:12.380665 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d6bdadab-efdd-419b-a780-3b4780dffb00 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:12.382250 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d6bdadab-efdd-419b-a780-3b4780dffb00 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:12.384118 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d03bdc89-40dc-4e44-8e26-2c04ad157729 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:12.385409 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:12.385409 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:12.389023 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d03bdc89-40dc-4e44-8e26-2c04ad157729 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:12.389707 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d03bdc89-40dc-4e44-8e26-2c04ad157729 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:12.393072 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:12.393072 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:12.628096 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-d6bdadab-efdd-419b-a780-3b4780dffb00 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:12.631007 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:12.631007 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:12.639762 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-d6bdadab-efdd-419b-a780-3b4780dffb00 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1566 microversion: 2.1 time: 0.276453 Jul 13 02:30:12.640641 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 270/537] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:12 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1566 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:12.645393 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-21cad771-b6c9-459e-ab8d-77466db2835a tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:12.646127 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-21cad771-b6c9-459e-ab8d-77466db2835a tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 325ba981-747f-4908-a6d4-529a36297483] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:12.653198 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-21cad771-b6c9-459e-ab8d-77466db2835a tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:12.653896 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-21cad771-b6c9-459e-ab8d-77466db2835a tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:12.654768 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-21cad771-b6c9-459e-ab8d-77466db2835a tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:12.655275 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-21cad771-b6c9-459e-ab8d-77466db2835a tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:12.658586 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:12.658586 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:12.756756 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-d03bdc89-40dc-4e44-8e26-2c04ad157729 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:12.759637 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:12.759637 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:12.774482 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-d03bdc89-40dc-4e44-8e26-2c04ad157729 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:12.776014 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-d03bdc89-40dc-4e44-8e26-2c04ad157729 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:12.779697 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-d03bdc89-40dc-4e44-8e26-2c04ad157729 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1810 microversion: 2.20 time: 0.434302 Jul 13 02:30:12.792126 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 268/538] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:30:12 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1810 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:30:12.797070 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-fded8635-a8cb-4dbd-8ebc-11abfb4273ab tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:12.797686 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-fded8635-a8cb-4dbd-8ebc-11abfb4273ab tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: 55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:12.805398 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-fded8635-a8cb-4dbd-8ebc-11abfb4273ab tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:12.805849 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-fded8635-a8cb-4dbd-8ebc-11abfb4273ab tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:12.806948 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-fded8635-a8cb-4dbd-8ebc-11abfb4273ab tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:12.807399 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-fded8635-a8cb-4dbd-8ebc-11abfb4273ab tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:12.810987 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:12.810987 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:12.843592 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-21cad771-b6c9-459e-ab8d-77466db2835a tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21025e2c8aa9423dbd05da95f237b481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2c1d46685432e8656123be9d86664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:12.846464 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:12.846464 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:12.854810 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-21cad771-b6c9-459e-ab8d-77466db2835a tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "GET /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483" status: 200 len: 1222 microversion: 2.1 time: 0.213100 Jul 13 02:30:12.855665 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 271/539] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:12 2021] GET /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483 => generated 1222 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:13.008836 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-fded8635-a8cb-4dbd-8ebc-11abfb4273ab tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:13.011455 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:13.011455 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:13.019302 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-fded8635-a8cb-4dbd-8ebc-11abfb4273ab tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf" status: 200 len: 1514 microversion: 2.1 time: 0.226064 Jul 13 02:30:13.019876 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 269/540] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:12 2021] GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf => generated 1514 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:13.656558 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-b81eceaf-3d19-4792-ac30-d61f123063c2 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:13.657178 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-b81eceaf-3d19-4792-ac30-d61f123063c2 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:13.667715 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b81eceaf-3d19-4792-ac30-d61f123063c2 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:13.668167 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b81eceaf-3d19-4792-ac30-d61f123063c2 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:13.668952 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b81eceaf-3d19-4792-ac30-d61f123063c2 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:13.669413 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b81eceaf-3d19-4792-ac30-d61f123063c2 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:13.672555 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:13.672555 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:13.798009 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-0abfdeb4-5615-47bc-b619-603efe0414eb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:13.798631 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-0abfdeb4-5615-47bc-b619-603efe0414eb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:13.804924 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-0abfdeb4-5615-47bc-b619-603efe0414eb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:13.805362 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-0abfdeb4-5615-47bc-b619-603efe0414eb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:13.806176 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-0abfdeb4-5615-47bc-b619-603efe0414eb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:13.806613 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-0abfdeb4-5615-47bc-b619-603efe0414eb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:13.810759 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:13.810759 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:13.879485 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-b81eceaf-3d19-4792-ac30-d61f123063c2 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:13.882185 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:13.882185 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:13.896746 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-b81eceaf-3d19-4792-ac30-d61f123063c2 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1566 microversion: 2.1 time: 0.243265 Jul 13 02:30:13.897550 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 272/541] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:13 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1566 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:13.902237 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-08cb3a0e-2c21-4bd0-a323-363e56c2d202 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:13.902854 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-08cb3a0e-2c21-4bd0-a323-363e56c2d202 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 325ba981-747f-4908-a6d4-529a36297483] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:13.909102 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-08cb3a0e-2c21-4bd0-a323-363e56c2d202 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:13.909505 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-08cb3a0e-2c21-4bd0-a323-363e56c2d202 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:13.910704 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-08cb3a0e-2c21-4bd0-a323-363e56c2d202 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:13.910704 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-08cb3a0e-2c21-4bd0-a323-363e56c2d202 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:13.914621 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:13.914621 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:14.017360 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-0abfdeb4-5615-47bc-b619-603efe0414eb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:14.019992 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:14.019992 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:14.029350 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-0abfdeb4-5615-47bc-b619-603efe0414eb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:14.030861 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-0abfdeb4-5615-47bc-b619-603efe0414eb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:14.032099 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-0abfdeb4-5615-47bc-b619-603efe0414eb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1810 microversion: 2.20 time: 0.237762 Jul 13 02:30:14.032817 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 270/542] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:30:13 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1810 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:30:14.036913 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-08cb3a0e-2c21-4bd0-a323-363e56c2d202 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21025e2c8aa9423dbd05da95f237b481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2c1d46685432e8656123be9d86664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:14.037653 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-5128e304-1e04-41cb-80b7-559c5d40d433 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:14.038289 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-5128e304-1e04-41cb-80b7-559c5d40d433 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: 55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:14.039778 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:14.039778 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:14.045133 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5128e304-1e04-41cb-80b7-559c5d40d433 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:14.045730 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5128e304-1e04-41cb-80b7-559c5d40d433 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:14.046631 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5128e304-1e04-41cb-80b7-559c5d40d433 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:14.047117 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5128e304-1e04-41cb-80b7-559c5d40d433 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:14.047611 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-08cb3a0e-2c21-4bd0-a323-363e56c2d202 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "GET /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483" status: 200 len: 1222 microversion: 2.1 time: 0.148577 Jul 13 02:30:14.048608 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 273/543] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:13 2021] GET /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483 => generated 1222 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:14.061850 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:14.061850 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:14.267582 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-5128e304-1e04-41cb-80b7-559c5d40d433 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:14.270214 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:14.270214 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:14.278555 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-5128e304-1e04-41cb-80b7-559c5d40d433 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf" status: 200 len: 1514 microversion: 2.1 time: 0.244912 Jul 13 02:30:14.279670 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 271/544] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:14 2021] GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf => generated 1514 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:14.916589 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-4e0c78f0-8cf4-4cb6-8b27-4df2a5b5dfb9 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:14.919816 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-4e0c78f0-8cf4-4cb6-8b27-4df2a5b5dfb9 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:14.931425 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4e0c78f0-8cf4-4cb6-8b27-4df2a5b5dfb9 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:14.932296 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4e0c78f0-8cf4-4cb6-8b27-4df2a5b5dfb9 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:14.933079 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4e0c78f0-8cf4-4cb6-8b27-4df2a5b5dfb9 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:14.935155 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4e0c78f0-8cf4-4cb6-8b27-4df2a5b5dfb9 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:14.940878 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:14.940878 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:15.050757 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-709e1710-bf22-498c-8cf5-04cbc323f994 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:15.052062 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-709e1710-bf22-498c-8cf5-04cbc323f994 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:15.058937 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-709e1710-bf22-498c-8cf5-04cbc323f994 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:15.060455 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-709e1710-bf22-498c-8cf5-04cbc323f994 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:15.061565 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-709e1710-bf22-498c-8cf5-04cbc323f994 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:15.062207 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-709e1710-bf22-498c-8cf5-04cbc323f994 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:15.065507 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:15.065507 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:15.145229 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-4e0c78f0-8cf4-4cb6-8b27-4df2a5b5dfb9 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:15.148765 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:15.148765 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:15.156654 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-4e0c78f0-8cf4-4cb6-8b27-4df2a5b5dfb9 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1566 microversion: 2.1 time: 0.246129 Jul 13 02:30:15.157652 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 274/545] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:14 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1566 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:15.163151 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-fef76eb9-09d1-4ffe-8cfd-805dc536f0a7 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:15.163756 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-fef76eb9-09d1-4ffe-8cfd-805dc536f0a7 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 325ba981-747f-4908-a6d4-529a36297483] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:15.169931 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-fef76eb9-09d1-4ffe-8cfd-805dc536f0a7 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:15.170354 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-fef76eb9-09d1-4ffe-8cfd-805dc536f0a7 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:15.171117 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-fef76eb9-09d1-4ffe-8cfd-805dc536f0a7 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:15.171552 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-fef76eb9-09d1-4ffe-8cfd-805dc536f0a7 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:15.174501 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:15.174501 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:15.253226 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-709e1710-bf22-498c-8cf5-04cbc323f994 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:15.256791 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:15.256791 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:15.267487 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-709e1710-bf22-498c-8cf5-04cbc323f994 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:15.269043 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-709e1710-bf22-498c-8cf5-04cbc323f994 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:15.270235 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-709e1710-bf22-498c-8cf5-04cbc323f994 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1810 microversion: 2.20 time: 0.223627 Jul 13 02:30:15.271066 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 272/546] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:30:15 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1810 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:30:15.284928 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-fef76eb9-09d1-4ffe-8cfd-805dc536f0a7 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21025e2c8aa9423dbd05da95f237b481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2c1d46685432e8656123be9d86664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:15.287757 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:15.287757 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:15.294762 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-fef76eb9-09d1-4ffe-8cfd-805dc536f0a7 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "GET /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483" status: 200 len: 1222 microversion: 2.1 time: 0.135329 Jul 13 02:30:15.295325 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 275/547] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:15 2021] GET /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483 => generated 1222 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:15.295793 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-ed16da73-2620-41fc-b99d-9a7bf4f3e1a2 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:15.296484 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-ed16da73-2620-41fc-b99d-9a7bf4f3e1a2 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: 55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:15.302972 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ed16da73-2620-41fc-b99d-9a7bf4f3e1a2 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:15.303426 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ed16da73-2620-41fc-b99d-9a7bf4f3e1a2 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:15.304199 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ed16da73-2620-41fc-b99d-9a7bf4f3e1a2 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:15.304627 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ed16da73-2620-41fc-b99d-9a7bf4f3e1a2 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:15.307520 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:15.307520 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:15.475313 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-ed16da73-2620-41fc-b99d-9a7bf4f3e1a2 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:15.477835 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:15.477835 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:15.484681 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-ed16da73-2620-41fc-b99d-9a7bf4f3e1a2 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf" status: 200 len: 1514 microversion: 2.1 time: 0.192603 Jul 13 02:30:15.485246 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 273/548] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:15 2021] GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf => generated 1514 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:30:16.173887 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-5ad2e08d-ade7-420c-a170-4f62f9057e3b tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:16.174538 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-5ad2e08d-ade7-420c-a170-4f62f9057e3b tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:16.180923 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5ad2e08d-ade7-420c-a170-4f62f9057e3b tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:16.181379 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5ad2e08d-ade7-420c-a170-4f62f9057e3b tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:16.182185 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5ad2e08d-ade7-420c-a170-4f62f9057e3b tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:16.182628 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5ad2e08d-ade7-420c-a170-4f62f9057e3b tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:16.185663 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:16.185663 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:16.288141 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-5f36ba9c-9927-43d6-aac0-741d8cb46311 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:16.288810 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-5f36ba9c-9927-43d6-aac0-741d8cb46311 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:16.294820 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5f36ba9c-9927-43d6-aac0-741d8cb46311 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:16.295520 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5f36ba9c-9927-43d6-aac0-741d8cb46311 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:16.296501 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5f36ba9c-9927-43d6-aac0-741d8cb46311 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:16.297022 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5f36ba9c-9927-43d6-aac0-741d8cb46311 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:16.300491 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:16.300491 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:16.450974 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-5ad2e08d-ade7-420c-a170-4f62f9057e3b tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:16.454056 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:16.454056 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:16.462285 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-5ad2e08d-ade7-420c-a170-4f62f9057e3b tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1566 microversion: 2.1 time: 0.292106 Jul 13 02:30:16.462874 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 276/549] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:16 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1566 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:16.470259 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-f20c78b2-c22a-46cd-a561-e108ec3bd7fa tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:16.471061 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-f20c78b2-c22a-46cd-a561-e108ec3bd7fa tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 325ba981-747f-4908-a6d4-529a36297483] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:16.478358 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f20c78b2-c22a-46cd-a561-e108ec3bd7fa tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:16.478809 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f20c78b2-c22a-46cd-a561-e108ec3bd7fa tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:16.479632 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f20c78b2-c22a-46cd-a561-e108ec3bd7fa tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:16.480068 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f20c78b2-c22a-46cd-a561-e108ec3bd7fa tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:16.484091 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:16.484091 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:16.622967 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-f20c78b2-c22a-46cd-a561-e108ec3bd7fa tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21025e2c8aa9423dbd05da95f237b481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2c1d46685432e8656123be9d86664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:16.625593 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:16.625593 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:16.632983 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-f20c78b2-c22a-46cd-a561-e108ec3bd7fa tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "GET /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483" status: 200 len: 1270 microversion: 2.1 time: 0.166884 Jul 13 02:30:16.643090 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 277/550] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:16 2021] GET /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483 => generated 1270 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:16.643090 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-0b4b0f01-29a1-4e48-9e70-c1414938224c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:16.643090 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-0b4b0f01-29a1-4e48-9e70-c1414938224c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: 55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:16.648112 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0b4b0f01-29a1-4e48-9e70-c1414938224c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:16.648568 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0b4b0f01-29a1-4e48-9e70-c1414938224c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:16.649356 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0b4b0f01-29a1-4e48-9e70-c1414938224c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:16.649797 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0b4b0f01-29a1-4e48-9e70-c1414938224c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:16.650452 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-5f36ba9c-9927-43d6-aac0-741d8cb46311 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:16.652970 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:16.652970 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:16.653284 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:16.653284 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:16.662393 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-5f36ba9c-9927-43d6-aac0-741d8cb46311 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:16.664209 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-5f36ba9c-9927-43d6-aac0-741d8cb46311 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:16.665641 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-5f36ba9c-9927-43d6-aac0-741d8cb46311 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1810 microversion: 2.20 time: 0.381195 Jul 13 02:30:16.676116 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 274/551] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:30:16 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1810 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:30:16.912604 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-0b4b0f01-29a1-4e48-9e70-c1414938224c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:16.915216 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:16.915216 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:16.922176 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-0b4b0f01-29a1-4e48-9e70-c1414938224c tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf" status: 200 len: 1514 microversion: 2.1 time: 0.287608 Jul 13 02:30:16.922745 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 278/552] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:16 2021] GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf => generated 1514 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:17.480109 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-c9bc6509-cbc3-43b8-a861-6e3712374b5e tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:17.480840 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-c9bc6509-cbc3-43b8-a861-6e3712374b5e tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:17.486725 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c9bc6509-cbc3-43b8-a861-6e3712374b5e tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:17.487247 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c9bc6509-cbc3-43b8-a861-6e3712374b5e tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:17.488014 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c9bc6509-cbc3-43b8-a861-6e3712374b5e tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:17.488448 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c9bc6509-cbc3-43b8-a861-6e3712374b5e tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:17.492052 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:17.492052 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:17.650435 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-f64506d3-a369-4a7e-a80c-d5086b7854e6 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:17.651998 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-f64506d3-a369-4a7e-a80c-d5086b7854e6 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 325ba981-747f-4908-a6d4-529a36297483] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:17.657799 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f64506d3-a369-4a7e-a80c-d5086b7854e6 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:17.658536 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f64506d3-a369-4a7e-a80c-d5086b7854e6 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:17.659519 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f64506d3-a369-4a7e-a80c-d5086b7854e6 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:17.659947 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f64506d3-a369-4a7e-a80c-d5086b7854e6 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:17.663586 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:17.663586 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:17.985385 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-f64506d3-a369-4a7e-a80c-d5086b7854e6 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21025e2c8aa9423dbd05da95f237b481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2c1d46685432e8656123be9d86664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:17.988006 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:17.988006 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:17.995857 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-f64506d3-a369-4a7e-a80c-d5086b7854e6 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "GET /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483" status: 200 len: 1276 microversion: 2.1 time: 0.349320 Jul 13 02:30:17.997033 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 279/553] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:17 2021] GET /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483 => generated 1276 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:30:18.001416 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-860e044c-49e0-433d-8a8f-d5b7e9c66f3b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:18.002013 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-860e044c-49e0-433d-8a8f-d5b7e9c66f3b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:18.008550 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-860e044c-49e0-433d-8a8f-d5b7e9c66f3b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:18.008550 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-860e044c-49e0-433d-8a8f-d5b7e9c66f3b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:18.009067 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-860e044c-49e0-433d-8a8f-d5b7e9c66f3b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:18.009499 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-860e044c-49e0-433d-8a8f-d5b7e9c66f3b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:18.012589 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:18.012589 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:18.076382 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-c9bc6509-cbc3-43b8-a861-6e3712374b5e tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:18.079250 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:18.079250 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:18.087241 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-c9bc6509-cbc3-43b8-a861-6e3712374b5e tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1566 microversion: 2.1 time: 0.611120 Jul 13 02:30:18.088898 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 275/554] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:17 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1566 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:18.093781 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-e71ac586-b567-4bcd-8690-ae16615c88e6 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:18.094458 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-e71ac586-b567-4bcd-8690-ae16615c88e6 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: 55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:18.101109 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e71ac586-b567-4bcd-8690-ae16615c88e6 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:18.101559 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e71ac586-b567-4bcd-8690-ae16615c88e6 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:18.102377 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e71ac586-b567-4bcd-8690-ae16615c88e6 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:18.102995 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e71ac586-b567-4bcd-8690-ae16615c88e6 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:18.106065 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:18.106065 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:18.396543 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-860e044c-49e0-433d-8a8f-d5b7e9c66f3b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:18.399595 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:18.399595 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:18.409429 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-860e044c-49e0-433d-8a8f-d5b7e9c66f3b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:18.411437 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-860e044c-49e0-433d-8a8f-d5b7e9c66f3b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:18.412923 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-860e044c-49e0-433d-8a8f-d5b7e9c66f3b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1810 microversion: 2.20 time: 0.414941 Jul 13 02:30:18.413991 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 280/555] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:30:17 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1810 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:30:18.469037 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-e71ac586-b567-4bcd-8690-ae16615c88e6 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:18.471689 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:18.471689 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:18.479185 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-e71ac586-b567-4bcd-8690-ae16615c88e6 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf" status: 200 len: 1514 microversion: 2.1 time: 0.389016 Jul 13 02:30:18.479766 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 276/556] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:18 2021] GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf => generated 1514 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:18.812189 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [req-847711e3-8be6-4f91-800b-69a8b7de2463 req-7d368eec-c814-4972-86d2-8b2df59d27ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf", "name": "network-vif-deleted", "tag": "543eb3b5-2e4c-41c7-a86e-841db9532b16"}]} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:30:18.814916 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:30:18.814916 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: warnings.warn(msg) Jul 13 02:30:18.823010 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-847711e3-8be6-4f91-800b-69a8b7de2463 req-7d368eec-c814-4972-86d2-8b2df59d27ba service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:18.823710 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-847711e3-8be6-4f91-800b-69a8b7de2463 req-7d368eec-c814-4972-86d2-8b2df59d27ba service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:18.837925 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.compute.server_external_events [req-847711e3-8be6-4f91-800b-69a8b7de2463 req-7d368eec-c814-4972-86d2-8b2df59d27ba service nova] Creating event network-vif-deleted:543eb3b5-2e4c-41c7-a86e-841db9532b16 for instance 55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf on hv-cinder-78102 Jul 13 02:30:18.844596 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [req-847711e3-8be6-4f91-800b-69a8b7de2463 req-7d368eec-c814-4972-86d2-8b2df59d27ba service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035756 Jul 13 02:30:18.846967 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 281/557] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:30:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:30:19.012488 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-40a9b576-ad9e-4c4e-b167-44e21b1c2405 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:19.013412 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-40a9b576-ad9e-4c4e-b167-44e21b1c2405 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 325ba981-747f-4908-a6d4-529a36297483] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:19.020181 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-40a9b576-ad9e-4c4e-b167-44e21b1c2405 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:19.020647 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-40a9b576-ad9e-4c4e-b167-44e21b1c2405 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:19.021719 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-40a9b576-ad9e-4c4e-b167-44e21b1c2405 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:19.022331 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-40a9b576-ad9e-4c4e-b167-44e21b1c2405 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:19.027348 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:19.027348 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:19.105639 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-31d87cba-b824-469b-9c52-7b5deaf27e8f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:19.106360 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-31d87cba-b824-469b-9c52-7b5deaf27e8f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:19.112301 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-31d87cba-b824-469b-9c52-7b5deaf27e8f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:19.112749 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-31d87cba-b824-469b-9c52-7b5deaf27e8f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:19.113514 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-31d87cba-b824-469b-9c52-7b5deaf27e8f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:19.113945 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-31d87cba-b824-469b-9c52-7b5deaf27e8f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:19.117358 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:19.117358 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:19.348867 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-40a9b576-ad9e-4c4e-b167-44e21b1c2405 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21025e2c8aa9423dbd05da95f237b481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2c1d46685432e8656123be9d86664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:19.351704 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:19.351704 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:19.359008 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-40a9b576-ad9e-4c4e-b167-44e21b1c2405 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "GET /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483" status: 200 len: 1318 microversion: 2.1 time: 0.350168 Jul 13 02:30:19.369982 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 277/558] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:19 2021] GET /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483 => generated 1318 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:19.376529 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-ae94684f-57de-4f5f-8d0a-a3e51f43ae5e req-f4c11846-4649-4a1b-9952-f2192915c60c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "325ba981-747f-4908-a6d4-529a36297483", "tag": "e36bc09f-287f-4d23-8b1e-388f63fb032f"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:30:19.378546 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:30:19.378546 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:30:19.386506 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-ae94684f-57de-4f5f-8d0a-a3e51f43ae5e req-f4c11846-4649-4a1b-9952-f2192915c60c service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:19.387040 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-ae94684f-57de-4f5f-8d0a-a3e51f43ae5e req-f4c11846-4649-4a1b-9952-f2192915c60c service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:19.392361 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-31d87cba-b824-469b-9c52-7b5deaf27e8f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:19.396446 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:19.396446 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:19.401297 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-ae94684f-57de-4f5f-8d0a-a3e51f43ae5e req-f4c11846-4649-4a1b-9952-f2192915c60c service nova] Creating event network-changed:e36bc09f-287f-4d23-8b1e-388f63fb032f for instance 325ba981-747f-4908-a6d4-529a36297483 on hv-cinder-78102 Jul 13 02:30:19.404263 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-31d87cba-b824-469b-9c52-7b5deaf27e8f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1566 microversion: 2.1 time: 0.302579 Jul 13 02:30:19.405290 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 282/559] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:19 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1566 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:30:19.407305 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-ae94684f-57de-4f5f-8d0a-a3e51f43ae5e req-f4c11846-4649-4a1b-9952-f2192915c60c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035750 Jul 13 02:30:19.408344 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 278/560] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:30:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:30:19.431662 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-ad25647f-5134-4763-a90e-cf68329fddd0 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:19.432268 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-ad25647f-5134-4763-a90e-cf68329fddd0 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:19.437965 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ad25647f-5134-4763-a90e-cf68329fddd0 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:19.438444 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ad25647f-5134-4763-a90e-cf68329fddd0 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:19.439204 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ad25647f-5134-4763-a90e-cf68329fddd0 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:19.439636 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ad25647f-5134-4763-a90e-cf68329fddd0 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:19.442529 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:19.442529 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:19.497610 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-a6befb3f-2781-4bf7-a849-d20e5385ecd9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:19.498450 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-a6befb3f-2781-4bf7-a849-d20e5385ecd9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: 55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:19.504539 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a6befb3f-2781-4bf7-a849-d20e5385ecd9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:19.505180 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a6befb3f-2781-4bf7-a849-d20e5385ecd9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:19.506509 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a6befb3f-2781-4bf7-a849-d20e5385ecd9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:19.506946 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a6befb3f-2781-4bf7-a849-d20e5385ecd9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:19.509870 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:19.509870 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:19.585970 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a6befb3f-2781-4bf7-a849-d20e5385ecd9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:19.586353 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a6befb3f-2781-4bf7-a849-d20e5385ecd9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:19.586820 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.objects.instance [None req-a6befb3f-2781-4bf7-a849-d20e5385ecd9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lazy-loading 'fault' on Instance uuid 55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf {{(pid=107262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 13 02:30:19.589335 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:4002: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:19.589335 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: for row in query: Jul 13 02:30:19.642000 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-a6befb3f-2781-4bf7-a849-d20e5385ecd9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:19.644771 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:19.644771 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:19.651850 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-a6befb3f-2781-4bf7-a849-d20e5385ecd9 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf" status: 200 len: 1307 microversion: 2.1 time: 0.158286 Jul 13 02:30:19.652421 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 279/561] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:19 2021] GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf => generated 1307 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:19.768582 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-ad25647f-5134-4763-a90e-cf68329fddd0 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:19.772926 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:19.772926 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:19.781498 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-ad25647f-5134-4763-a90e-cf68329fddd0 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:19.783071 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-ad25647f-5134-4763-a90e-cf68329fddd0 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:19.784220 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-ad25647f-5134-4763-a90e-cf68329fddd0 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1810 microversion: 2.20 time: 0.356848 Jul 13 02:30:19.784782 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 283/562] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:30:19 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1810 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:30:20.376440 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-cd95ad9e-60b6-4a6d-9a2d-1a3ec0e9b1a8 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:20.377143 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-cd95ad9e-60b6-4a6d-9a2d-1a3ec0e9b1a8 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 325ba981-747f-4908-a6d4-529a36297483] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:20.382959 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-cd95ad9e-60b6-4a6d-9a2d-1a3ec0e9b1a8 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:20.383404 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-cd95ad9e-60b6-4a6d-9a2d-1a3ec0e9b1a8 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:20.384173 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-cd95ad9e-60b6-4a6d-9a2d-1a3ec0e9b1a8 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:20.384604 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-cd95ad9e-60b6-4a6d-9a2d-1a3ec0e9b1a8 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:20.387542 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:20.387542 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:20.420422 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-adfc47bc-b967-432d-a37e-f8b633e733c9 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:20.421063 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-adfc47bc-b967-432d-a37e-f8b633e733c9 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:20.426827 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-adfc47bc-b967-432d-a37e-f8b633e733c9 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:20.427505 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-adfc47bc-b967-432d-a37e-f8b633e733c9 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:20.428348 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-adfc47bc-b967-432d-a37e-f8b633e733c9 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:20.428844 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-adfc47bc-b967-432d-a37e-f8b633e733c9 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:20.431958 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:20.431958 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:20.625894 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-cd95ad9e-60b6-4a6d-9a2d-1a3ec0e9b1a8 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21025e2c8aa9423dbd05da95f237b481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2c1d46685432e8656123be9d86664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:20.628651 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:20.628651 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:20.636296 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-cd95ad9e-60b6-4a6d-9a2d-1a3ec0e9b1a8 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "GET /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483" status: 200 len: 1318 microversion: 2.1 time: 0.263523 Jul 13 02:30:20.636952 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 280/563] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:20 2021] GET /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483 => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:20.645654 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-adfc47bc-b967-432d-a37e-f8b633e733c9 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:20.648994 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:20.648994 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:20.656363 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-adfc47bc-b967-432d-a37e-f8b633e733c9 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1546 microversion: 2.1 time: 0.239642 Jul 13 02:30:20.656933 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 284/564] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:20 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1546 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:30:20.668292 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-7ecb10a7-2496-4b6e-9f10-3365f406a196 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:20.668904 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-7ecb10a7-2496-4b6e-9f10-3365f406a196 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: 55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:20.671996 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-253a9249-d87b-4a32-b5f8-7e8f203516ea tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:20.672427 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-253a9249-d87b-4a32-b5f8-7e8f203516ea tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:20.674988 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7ecb10a7-2496-4b6e-9f10-3365f406a196 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:20.675505 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7ecb10a7-2496-4b6e-9f10-3365f406a196 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:20.676343 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7ecb10a7-2496-4b6e-9f10-3365f406a196 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:20.676779 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7ecb10a7-2496-4b6e-9f10-3365f406a196 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:20.678532 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-253a9249-d87b-4a32-b5f8-7e8f203516ea tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:20.678976 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-253a9249-d87b-4a32-b5f8-7e8f203516ea tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:20.679741 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-253a9249-d87b-4a32-b5f8-7e8f203516ea tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:20.679944 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:20.679944 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:20.680167 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-253a9249-d87b-4a32-b5f8-7e8f203516ea tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:20.682971 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:20.682971 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:20.723708 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.wsgi [None req-7ecb10a7-2496-4b6e-9f10-3365f406a196 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] HTTP exception thrown: Instance 55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf could not be found. Jul 13 02:30:20.724842 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-7ecb10a7-2496-4b6e-9f10-3365f406a196 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Returning 404 to user: Instance 55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf could not be found. {{(pid=107262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:30:20.725682 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-7ecb10a7-2496-4b6e-9f10-3365f406a196 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf" status: 404 len: 111 microversion: 2.1 time: 0.061078 Jul 13 02:30:20.726476 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 281/565] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:20 2021] GET /compute/v2.1/servers/55e8f40c-60d0-4073-a1a8-4a4bd29a7fcf => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 02:30:20.733940 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-1cc57001-d702-46de-bb10-fbb98fd1439f tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:20.734550 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-1cc57001-d702-46de-bb10-fbb98fd1439f tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d5e93419-e7dd-4cb3-9370-d46ec80bac7c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:20.740821 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1cc57001-d702-46de-bb10-fbb98fd1439f tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:20.741268 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1cc57001-d702-46de-bb10-fbb98fd1439f tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:20.742060 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1cc57001-d702-46de-bb10-fbb98fd1439f tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:20.742495 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1cc57001-d702-46de-bb10-fbb98fd1439f tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:20.745357 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:20.745357 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:20.805382 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3031: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:20.805382 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context, Jul 13 02:30:20.807763 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-1cc57001-d702-46de-bb10-fbb98fd1439f tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d5e93419-e7dd-4cb3-9370-d46ec80bac7c] Going to try to terminate instance {{(pid=107262) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 13 02:30:20.809984 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3008: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:20.809984 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).\ Jul 13 02:30:20.812056 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.wsgi [None req-253a9249-d87b-4a32-b5f8-7e8f203516ea tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] HTTP exception thrown: Cannot 'detach_volume' instance 163ad440-5d5c-420d-ab44-52f27c5e22dc while it is in vm_state rescued Jul 13 02:30:20.812657 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-253a9249-d87b-4a32-b5f8-7e8f203516ea tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Returning 409 to user: Cannot 'detach_volume' instance 163ad440-5d5c-420d-ab44-52f27c5e22dc while it is in vm_state rescued {{(pid=107263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:30:20.813521 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-253a9249-d87b-4a32-b5f8-7e8f203516ea tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "DELETE /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc/os-volume_attachments/e3226124-85f2-46fa-ac19-c03530db7a21" status: 409 len: 152 microversion: 2.1 time: 0.145284 Jul 13 02:30:20.814121 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 285/566] 10.222.0.32 () {58 vars in 1416 bytes} [Tue Jul 13 02:30:20 2021] DELETE /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc/os-volume_attachments/e3226124-85f2-46fa-ac19-c03530db7a21 => generated 152 bytes in 146 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jul 13 02:30:20.818704 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-bb9decb1-e947-4b59-95d1-5461e3d2e34a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:20.819301 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-bb9decb1-e947-4b59-95d1-5461e3d2e34a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:20.822820 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:20.822820 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:20.825058 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-bb9decb1-e947-4b59-95d1-5461e3d2e34a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:20.825507 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-bb9decb1-e947-4b59-95d1-5461e3d2e34a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:20.826291 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-bb9decb1-e947-4b59-95d1-5461e3d2e34a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:20.826729 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-bb9decb1-e947-4b59-95d1-5461e3d2e34a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:20.887750 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/update_match.py:472: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:20.887750 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = query.session.execute(update_stmt) Jul 13 02:30:20.903626 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:530: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:20.903626 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = model_query(context, models.Service, read_deleted="no").\ Jul 13 02:30:20.940531 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-1cc57001-d702-46de-bb10-fbb98fd1439f tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "DELETE /compute/v2.1/servers/d5e93419-e7dd-4cb3-9370-d46ec80bac7c" status: 204 len: 0 microversion: 2.1 time: 0.209823 Jul 13 02:30:20.942115 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 282/567] 10.222.0.32 () {58 vars in 1239 bytes} [Tue Jul 13 02:30:20 2021] DELETE /compute/v2.1/servers/d5e93419-e7dd-4cb3-9370-d46ec80bac7c => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 13 02:30:20.950336 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-55a77c5c-fc4b-4a5f-a35a-7fa3a484a9b6 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:30:20.951293 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-55a77c5c-fc4b-4a5f-a35a-7fa3a484a9b6 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:20.959596 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-55a77c5c-fc4b-4a5f-a35a-7fa3a484a9b6 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:20.960130 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-55a77c5c-fc4b-4a5f-a35a-7fa3a484a9b6 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:20.961038 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-55a77c5c-fc4b-4a5f-a35a-7fa3a484a9b6 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:20.961543 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-55a77c5c-fc4b-4a5f-a35a-7fa3a484a9b6 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:20.964731 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:20.964731 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:20.983377 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:20.983377 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:21.029873 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:21.029873 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:21.086961 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/update_match.py:472: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:21.086961 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = query.session.execute(update_stmt) Jul 13 02:30:21.109986 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-55a77c5c-fc4b-4a5f-a35a-7fa3a484a9b6 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "POST /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc/action" status: 202 len: 0 microversion: 2.1 time: 0.163885 Jul 13 02:30:21.110646 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 283/568] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:30:20 2021] POST /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:30:21.116098 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-f89889ca-bf96-41ba-9bc5-5121e4da1cc6 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:21.116865 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-f89889ca-bf96-41ba-9bc5-5121e4da1cc6 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d5e93419-e7dd-4cb3-9370-d46ec80bac7c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:21.122859 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f89889ca-bf96-41ba-9bc5-5121e4da1cc6 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:21.123301 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f89889ca-bf96-41ba-9bc5-5121e4da1cc6 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:21.124093 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f89889ca-bf96-41ba-9bc5-5121e4da1cc6 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:21.124523 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f89889ca-bf96-41ba-9bc5-5121e4da1cc6 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:21.127468 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:21.127468 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:21.168863 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-bb9decb1-e947-4b59-95d1-5461e3d2e34a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:21.171442 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:21.171442 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:21.179881 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-bb9decb1-e947-4b59-95d1-5461e3d2e34a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:21.181373 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-bb9decb1-e947-4b59-95d1-5461e3d2e34a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:21.182560 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-bb9decb1-e947-4b59-95d1-5461e3d2e34a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1810 microversion: 2.20 time: 0.367505 Jul 13 02:30:21.183513 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 286/569] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:30:20 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1810 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:30:21.187878 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-a1647ead-60f3-49d5-8e88-cba4f0e042ce tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:21.188389 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-a1647ead-60f3-49d5-8e88-cba4f0e042ce tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:21.195333 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a1647ead-60f3-49d5-8e88-cba4f0e042ce tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:21.195686 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a1647ead-60f3-49d5-8e88-cba4f0e042ce tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:21.196465 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a1647ead-60f3-49d5-8e88-cba4f0e042ce tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:21.196899 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a1647ead-60f3-49d5-8e88-cba4f0e042ce tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:21.200097 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:21.200097 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:21.319473 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3031: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:21.319473 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context, Jul 13 02:30:21.325697 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.objects.instance [None req-a1647ead-60f3-49d5-8e88-cba4f0e042ce tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lazy-loading 'services' on Instance uuid c8f2132c-4b9b-4c53-81c5-29e734143042 {{(pid=107263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 13 02:30:21.391844 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-a1647ead-60f3-49d5-8e88-cba4f0e042ce tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "DELETE /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/os-volume_attachments/c97ae636-48e5-4d15-bd95-e3e47f72dc15" status: 202 len: 0 microversion: 2.1 time: 0.207270 Jul 13 02:30:21.392417 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 287/570] 10.222.0.32 () {58 vars in 1416 bytes} [Tue Jul 13 02:30:21 2021] DELETE /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/os-volume_attachments/c97ae636-48e5-4d15-bd95-e3e47f72dc15 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:30:21.397629 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-dfd2c3d0-13c8-4e77-b49b-7dd783a1bfb2 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:21.398358 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-dfd2c3d0-13c8-4e77-b49b-7dd783a1bfb2 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:21.403971 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-f89889ca-bf96-41ba-9bc5-5121e4da1cc6 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:21.405606 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-dfd2c3d0-13c8-4e77-b49b-7dd783a1bfb2 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:21.406415 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-dfd2c3d0-13c8-4e77-b49b-7dd783a1bfb2 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:21.406613 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:21.406613 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:21.407595 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-dfd2c3d0-13c8-4e77-b49b-7dd783a1bfb2 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:21.408181 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-dfd2c3d0-13c8-4e77-b49b-7dd783a1bfb2 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:21.413254 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:21.413254 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:21.417713 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-f89889ca-bf96-41ba-9bc5-5121e4da1cc6 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/d5e93419-e7dd-4cb3-9370-d46ec80bac7c" status: 200 len: 1514 microversion: 2.1 time: 0.305073 Jul 13 02:30:21.418791 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 284/571] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:21 2021] GET /compute/v2.1/servers/d5e93419-e7dd-4cb3-9370-d46ec80bac7c => generated 1514 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:21.652721 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-cfecaf84-3f5b-45a5-a41d-c26887adfd48 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:21.653326 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-cfecaf84-3f5b-45a5-a41d-c26887adfd48 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 325ba981-747f-4908-a6d4-529a36297483] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:21.658978 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-cfecaf84-3f5b-45a5-a41d-c26887adfd48 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:21.659419 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-cfecaf84-3f5b-45a5-a41d-c26887adfd48 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:21.660168 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-cfecaf84-3f5b-45a5-a41d-c26887adfd48 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:21.660593 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-cfecaf84-3f5b-45a5-a41d-c26887adfd48 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:21.664585 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:21.664585 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:21.690561 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-dfd2c3d0-13c8-4e77-b49b-7dd783a1bfb2 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:21.694015 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:21.694015 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:21.704395 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-dfd2c3d0-13c8-4e77-b49b-7dd783a1bfb2 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1554 microversion: 2.1 time: 0.310750 Jul 13 02:30:21.705247 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 288/572] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:21 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1554 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:21.925053 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-cfecaf84-3f5b-45a5-a41d-c26887adfd48 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21025e2c8aa9423dbd05da95f237b481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2c1d46685432e8656123be9d86664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:21.927871 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:21.927871 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:21.935966 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-cfecaf84-3f5b-45a5-a41d-c26887adfd48 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "GET /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483" status: 200 len: 1318 microversion: 2.1 time: 0.285483 Jul 13 02:30:21.936542 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 285/573] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:21 2021] GET /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483 => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:22.201441 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-4ce87e56-acfc-4869-b70d-234dd64226c8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:22.202062 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-4ce87e56-acfc-4869-b70d-234dd64226c8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:22.208213 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4ce87e56-acfc-4869-b70d-234dd64226c8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:22.208687 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4ce87e56-acfc-4869-b70d-234dd64226c8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:22.209461 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4ce87e56-acfc-4869-b70d-234dd64226c8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:22.209893 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4ce87e56-acfc-4869-b70d-234dd64226c8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:22.212843 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:22.212843 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:22.389799 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-4ce87e56-acfc-4869-b70d-234dd64226c8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:22.392493 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:22.392493 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:22.400982 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-4ce87e56-acfc-4869-b70d-234dd64226c8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:22.402738 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-4ce87e56-acfc-4869-b70d-234dd64226c8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:22.403901 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-4ce87e56-acfc-4869-b70d-234dd64226c8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1810 microversion: 2.20 time: 0.206321 Jul 13 02:30:22.404453 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 289/574] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:30:22 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1810 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:30:22.435304 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-3f573f5f-a746-4259-bda0-3778dab2820b tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:22.436007 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-3f573f5f-a746-4259-bda0-3778dab2820b tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d5e93419-e7dd-4cb3-9370-d46ec80bac7c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:22.441759 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3f573f5f-a746-4259-bda0-3778dab2820b tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:22.442261 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3f573f5f-a746-4259-bda0-3778dab2820b tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:22.443353 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3f573f5f-a746-4259-bda0-3778dab2820b tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:22.443793 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3f573f5f-a746-4259-bda0-3778dab2820b tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:22.446927 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:22.446927 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:22.628508 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-3f573f5f-a746-4259-bda0-3778dab2820b tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:22.631532 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:22.631532 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:22.638582 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-3f573f5f-a746-4259-bda0-3778dab2820b tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/d5e93419-e7dd-4cb3-9370-d46ec80bac7c" status: 200 len: 1514 microversion: 2.1 time: 0.206937 Jul 13 02:30:22.639340 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 286/575] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:22 2021] GET /compute/v2.1/servers/d5e93419-e7dd-4cb3-9370-d46ec80bac7c => generated 1514 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:22.721967 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-4e66adc0-abb9-4c5a-85b0-9ec267f66f26 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:22.722604 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-4e66adc0-abb9-4c5a-85b0-9ec267f66f26 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:22.729120 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4e66adc0-abb9-4c5a-85b0-9ec267f66f26 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:22.729569 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4e66adc0-abb9-4c5a-85b0-9ec267f66f26 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:22.730391 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4e66adc0-abb9-4c5a-85b0-9ec267f66f26 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:22.730828 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4e66adc0-abb9-4c5a-85b0-9ec267f66f26 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:22.733677 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:22.733677 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:22.908325 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-4e66adc0-abb9-4c5a-85b0-9ec267f66f26 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:22.911249 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:22.911249 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:22.920180 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-4e66adc0-abb9-4c5a-85b0-9ec267f66f26 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1554 microversion: 2.1 time: 0.201845 Jul 13 02:30:22.920750 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 290/576] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:22 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1554 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:22.953350 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-d08e36ae-8820-49d5-8250-597579f2d839 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:22.954377 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-d08e36ae-8820-49d5-8250-597579f2d839 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 325ba981-747f-4908-a6d4-529a36297483] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:22.960662 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d08e36ae-8820-49d5-8250-597579f2d839 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:22.961101 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d08e36ae-8820-49d5-8250-597579f2d839 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:22.961864 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d08e36ae-8820-49d5-8250-597579f2d839 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:22.962308 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d08e36ae-8820-49d5-8250-597579f2d839 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:22.965263 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:22.965263 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:23.219831 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-d08e36ae-8820-49d5-8250-597579f2d839 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21025e2c8aa9423dbd05da95f237b481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2c1d46685432e8656123be9d86664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:23.222389 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:23.222389 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:23.229298 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-d08e36ae-8820-49d5-8250-597579f2d839 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "GET /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483" status: 200 len: 1318 microversion: 2.1 time: 0.279621 Jul 13 02:30:23.229875 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 287/577] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:22 2021] GET /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483 => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:23.423247 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-5ada4cf9-7261-42e3-88e1-21051b1a15de tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:23.423769 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-5ada4cf9-7261-42e3-88e1-21051b1a15de tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:23.430135 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5ada4cf9-7261-42e3-88e1-21051b1a15de tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:23.430583 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5ada4cf9-7261-42e3-88e1-21051b1a15de tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:23.431346 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5ada4cf9-7261-42e3-88e1-21051b1a15de tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:23.431775 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5ada4cf9-7261-42e3-88e1-21051b1a15de tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:23.434636 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:23.434636 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:23.593966 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-f826936d-1d25-48c0-b905-467d28083fb5 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:30:23.600479 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f826936d-1d25-48c0-b905-467d28083fb5 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:23.600923 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f826936d-1d25-48c0-b905-467d28083fb5 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:23.603608 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:23.603608 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:23.664672 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-f826936d-1d25-48c0-b905-467d28083fb5 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Going to try to stop instance {{(pid=107262) force_stop /opt/stack/nova/nova/compute/api.py:2582}} Jul 13 02:30:23.668249 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:23.668249 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:23.703078 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-5ada4cf9-7261-42e3-88e1-21051b1a15de tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:23.706011 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:23.706011 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:23.716549 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-5ada4cf9-7261-42e3-88e1-21051b1a15de tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:23.718099 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-5ada4cf9-7261-42e3-88e1-21051b1a15de tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:23.719455 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-5ada4cf9-7261-42e3-88e1-21051b1a15de tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1810 microversion: 2.20 time: 0.299985 Jul 13 02:30:23.720009 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 291/578] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:30:23 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1810 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:30:23.729794 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/update_match.py:472: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:23.729794 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = query.session.execute(update_stmt) Jul 13 02:30:23.731741 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [req-9821e2a4-6e45-44b4-9948-b0879a2b005c req-6f8c5a22-fe35-48dc-9a5d-b424373ad873 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5e93419-e7dd-4cb3-9370-d46ec80bac7c", "name": "network-vif-deleted", "tag": "a3decc40-d384-449b-b7b0-9d10dd653354"}]} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:30:23.733453 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:30:23.733453 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: warnings.warn(msg) Jul 13 02:30:23.740825 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-9821e2a4-6e45-44b4-9948-b0879a2b005c req-6f8c5a22-fe35-48dc-9a5d-b424373ad873 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:23.741364 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-9821e2a4-6e45-44b4-9948-b0879a2b005c req-6f8c5a22-fe35-48dc-9a5d-b424373ad873 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:23.752991 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.compute.server_external_events [req-9821e2a4-6e45-44b4-9948-b0879a2b005c req-6f8c5a22-fe35-48dc-9a5d-b424373ad873 service nova] Creating event network-vif-deleted:a3decc40-d384-449b-b7b0-9d10dd653354 for instance d5e93419-e7dd-4cb3-9370-d46ec80bac7c on hv-cinder-78102 Jul 13 02:30:23.753235 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-f826936d-1d25-48c0-b905-467d28083fb5 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 202 len: 0 microversion: 2.1 time: 0.162781 Jul 13 02:30:23.753831 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 288/579] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:30:23 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 13 02:30:23.759366 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-dbfa6299-9471-4ca4-bba7-75baa1e03bae tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:23.759523 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [req-9821e2a4-6e45-44b4-9948-b0879a2b005c req-6f8c5a22-fe35-48dc-9a5d-b424373ad873 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038122 Jul 13 02:30:23.760014 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 292/580] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:30:23 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:30:23.760162 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-dbfa6299-9471-4ca4-bba7-75baa1e03bae tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d5e93419-e7dd-4cb3-9370-d46ec80bac7c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:23.764952 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-424e1c16-af9a-4bf4-a70f-835bf1ae61a6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:23.765649 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-424e1c16-af9a-4bf4-a70f-835bf1ae61a6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:23.766373 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-dbfa6299-9471-4ca4-bba7-75baa1e03bae tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:23.766817 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-dbfa6299-9471-4ca4-bba7-75baa1e03bae tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:23.767610 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-dbfa6299-9471-4ca4-bba7-75baa1e03bae tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:23.768040 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-dbfa6299-9471-4ca4-bba7-75baa1e03bae tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:23.771562 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:23.771562 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:23.772300 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-424e1c16-af9a-4bf4-a70f-835bf1ae61a6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:23.772858 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-424e1c16-af9a-4bf4-a70f-835bf1ae61a6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:23.773697 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-424e1c16-af9a-4bf4-a70f-835bf1ae61a6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:23.774253 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-424e1c16-af9a-4bf4-a70f-835bf1ae61a6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:23.777166 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:23.777166 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:23.873187 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-dbfa6299-9471-4ca4-bba7-75baa1e03bae tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:23.875839 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:23.875839 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:23.883607 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-dbfa6299-9471-4ca4-bba7-75baa1e03bae tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/d5e93419-e7dd-4cb3-9370-d46ec80bac7c" status: 200 len: 1472 microversion: 2.1 time: 0.128597 Jul 13 02:30:23.884181 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 289/581] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:23 2021] GET /compute/v2.1/servers/d5e93419-e7dd-4cb3-9370-d46ec80bac7c => generated 1472 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:23.937337 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-50a0b4f4-a7da-474f-b8f8-6582ea98f6c7 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:23.938128 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-50a0b4f4-a7da-474f-b8f8-6582ea98f6c7 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:23.945448 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-50a0b4f4-a7da-474f-b8f8-6582ea98f6c7 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:23.946017 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-50a0b4f4-a7da-474f-b8f8-6582ea98f6c7 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:23.947062 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-50a0b4f4-a7da-474f-b8f8-6582ea98f6c7 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:23.947570 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-50a0b4f4-a7da-474f-b8f8-6582ea98f6c7 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:23.951010 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:23.951010 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:23.982138 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-424e1c16-af9a-4bf4-a70f-835bf1ae61a6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:23.984909 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:23.984909 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:23.992710 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-424e1c16-af9a-4bf4-a70f-835bf1ae61a6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1678 microversion: 2.1 time: 0.231580 Jul 13 02:30:23.993278 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 293/582] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:23 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1678 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:24.134017 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-50a0b4f4-a7da-474f-b8f8-6582ea98f6c7 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:24.136649 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:24.136649 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:24.144307 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-50a0b4f4-a7da-474f-b8f8-6582ea98f6c7 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1554 microversion: 2.1 time: 0.210930 Jul 13 02:30:24.144879 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 290/583] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:23 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1554 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:30:24.246757 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-a7f194f6-a9f4-4c3c-a51b-6fcff55fbd02 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:24.247374 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-a7f194f6-a9f4-4c3c-a51b-6fcff55fbd02 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 325ba981-747f-4908-a6d4-529a36297483] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:24.253063 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a7f194f6-a9f4-4c3c-a51b-6fcff55fbd02 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:24.253500 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a7f194f6-a9f4-4c3c-a51b-6fcff55fbd02 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:24.254276 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a7f194f6-a9f4-4c3c-a51b-6fcff55fbd02 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:24.254699 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a7f194f6-a9f4-4c3c-a51b-6fcff55fbd02 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:24.257502 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:24.257502 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:24.432805 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-a7f194f6-a9f4-4c3c-a51b-6fcff55fbd02 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21025e2c8aa9423dbd05da95f237b481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2c1d46685432e8656123be9d86664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:24.435382 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:24.435382 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:24.444326 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-a7f194f6-a9f4-4c3c-a51b-6fcff55fbd02 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "GET /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483" status: 200 len: 1318 microversion: 2.1 time: 0.201514 Jul 13 02:30:24.445114 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 294/584] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:24 2021] GET /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:24.543316 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-2eb17869-a4a2-427f-bedc-f35dae94cb22 req-4ed2bade-091d-4d06-84a6-468eda7096a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "325ba981-747f-4908-a6d4-529a36297483", "name": "network-vif-plugged", "status": "completed", "tag": "e36bc09f-287f-4d23-8b1e-388f63fb032f"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:30:24.545135 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:30:24.545135 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:30:24.552430 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-2eb17869-a4a2-427f-bedc-f35dae94cb22 req-4ed2bade-091d-4d06-84a6-468eda7096a8 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:24.552970 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-2eb17869-a4a2-427f-bedc-f35dae94cb22 req-4ed2bade-091d-4d06-84a6-468eda7096a8 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:24.574864 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-2eb17869-a4a2-427f-bedc-f35dae94cb22 req-4ed2bade-091d-4d06-84a6-468eda7096a8 service nova] Creating event network-vif-plugged:e36bc09f-287f-4d23-8b1e-388f63fb032f for instance 325ba981-747f-4908-a6d4-529a36297483 on hv-cinder-78102 Jul 13 02:30:24.580687 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-2eb17869-a4a2-427f-bedc-f35dae94cb22 req-4ed2bade-091d-4d06-84a6-468eda7096a8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041313 Jul 13 02:30:24.582169 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 291/585] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:30:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 02:30:24.740524 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-64db92ae-9725-4068-b991-92cb3e19ae17 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:24.741382 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-64db92ae-9725-4068-b991-92cb3e19ae17 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:24.748219 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-64db92ae-9725-4068-b991-92cb3e19ae17 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:24.748665 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-64db92ae-9725-4068-b991-92cb3e19ae17 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:24.749446 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-64db92ae-9725-4068-b991-92cb3e19ae17 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:24.749877 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-64db92ae-9725-4068-b991-92cb3e19ae17 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:24.753871 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:24.753871 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:24.905202 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-9458b3d5-6a06-405a-9894-1c9ee18241af tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:24.907086 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-9458b3d5-6a06-405a-9894-1c9ee18241af tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d5e93419-e7dd-4cb3-9370-d46ec80bac7c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:24.919824 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9458b3d5-6a06-405a-9894-1c9ee18241af tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:24.920267 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9458b3d5-6a06-405a-9894-1c9ee18241af tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:24.921058 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9458b3d5-6a06-405a-9894-1c9ee18241af tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:24.921489 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9458b3d5-6a06-405a-9894-1c9ee18241af tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:24.924903 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:24.924903 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:24.955327 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-64db92ae-9725-4068-b991-92cb3e19ae17 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:24.958129 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:24.958129 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:24.967424 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-64db92ae-9725-4068-b991-92cb3e19ae17 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:24.969061 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-64db92ae-9725-4068-b991-92cb3e19ae17 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:24.970235 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-64db92ae-9725-4068-b991-92cb3e19ae17 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1810 microversion: 2.20 time: 0.235121 Jul 13 02:30:24.970972 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 295/586] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:30:24 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1810 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:30:24.978679 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.wsgi [None req-9458b3d5-6a06-405a-9894-1c9ee18241af tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] HTTP exception thrown: Instance d5e93419-e7dd-4cb3-9370-d46ec80bac7c could not be found. Jul 13 02:30:24.979658 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-9458b3d5-6a06-405a-9894-1c9ee18241af tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Returning 404 to user: Instance d5e93419-e7dd-4cb3-9370-d46ec80bac7c could not be found. {{(pid=107262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:30:24.980553 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-9458b3d5-6a06-405a-9894-1c9ee18241af tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/d5e93419-e7dd-4cb3-9370-d46ec80bac7c" status: 404 len: 111 microversion: 2.1 time: 0.082545 Jul 13 02:30:24.981280 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 292/587] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:24 2021] GET /compute/v2.1/servers/d5e93419-e7dd-4cb3-9370-d46ec80bac7c => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 02:30:25.011475 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-c14f8cb5-de9f-49ad-a3e8-8f4441e6e54d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:25.013213 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-c14f8cb5-de9f-49ad-a3e8-8f4441e6e54d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:25.027689 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c14f8cb5-de9f-49ad-a3e8-8f4441e6e54d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:25.028508 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c14f8cb5-de9f-49ad-a3e8-8f4441e6e54d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:25.030724 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c14f8cb5-de9f-49ad-a3e8-8f4441e6e54d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:25.031446 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c14f8cb5-de9f-49ad-a3e8-8f4441e6e54d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:25.035916 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:25.035916 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:25.161652 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-2e94b0a5-614d-44eb-ac3b-0538e31ca32f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:25.163665 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-2e94b0a5-614d-44eb-ac3b-0538e31ca32f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:25.175433 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2e94b0a5-614d-44eb-ac3b-0538e31ca32f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:25.175882 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2e94b0a5-614d-44eb-ac3b-0538e31ca32f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:25.176664 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2e94b0a5-614d-44eb-ac3b-0538e31ca32f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:25.181083 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2e94b0a5-614d-44eb-ac3b-0538e31ca32f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:25.186954 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:25.186954 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:25.366888 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-c14f8cb5-de9f-49ad-a3e8-8f4441e6e54d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:25.369513 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:25.369513 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:25.383363 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-c14f8cb5-de9f-49ad-a3e8-8f4441e6e54d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1678 microversion: 2.1 time: 0.375458 Jul 13 02:30:25.394666 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 296/588] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:25 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1678 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:25.461340 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-fa6cdf31-9259-41b3-8d01-05c1f2180375 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:25.462405 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-fa6cdf31-9259-41b3-8d01-05c1f2180375 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 325ba981-747f-4908-a6d4-529a36297483] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:25.469236 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-fa6cdf31-9259-41b3-8d01-05c1f2180375 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:25.470189 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-fa6cdf31-9259-41b3-8d01-05c1f2180375 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:25.472019 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-fa6cdf31-9259-41b3-8d01-05c1f2180375 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:25.472695 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-fa6cdf31-9259-41b3-8d01-05c1f2180375 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:25.477339 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:25.477339 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:25.739021 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-2e94b0a5-614d-44eb-ac3b-0538e31ca32f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:25.741881 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:25.741881 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:25.749528 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-2e94b0a5-614d-44eb-ac3b-0538e31ca32f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1560 microversion: 2.1 time: 0.592816 Jul 13 02:30:25.750211 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 293/589] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:25 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1560 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:30:25.810846 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-fa6cdf31-9259-41b3-8d01-05c1f2180375 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21025e2c8aa9423dbd05da95f237b481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2c1d46685432e8656123be9d86664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:25.813756 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:25.813756 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:25.822792 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-fa6cdf31-9259-41b3-8d01-05c1f2180375 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "GET /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483" status: 200 len: 1318 microversion: 2.1 time: 0.365853 Jul 13 02:30:25.823677 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 297/590] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:25 2021] GET /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483 => generated 1318 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:30:25.824182 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-9c5cd515-d2cf-4b88-a9a0-7b024264fbc0 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:25.824679 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-9c5cd515-d2cf-4b88-a9a0-7b024264fbc0 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:25.830542 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9c5cd515-d2cf-4b88-a9a0-7b024264fbc0 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:25.830985 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9c5cd515-d2cf-4b88-a9a0-7b024264fbc0 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:25.831790 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9c5cd515-d2cf-4b88-a9a0-7b024264fbc0 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:25.832225 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9c5cd515-d2cf-4b88-a9a0-7b024264fbc0 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:25.839180 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:25.839180 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:25.956011 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3031: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:25.956011 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context, Jul 13 02:30:25.963134 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.objects.instance [None req-9c5cd515-d2cf-4b88-a9a0-7b024264fbc0 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lazy-loading 'services' on Instance uuid 163ad440-5d5c-420d-ab44-52f27c5e22dc {{(pid=107262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 13 02:30:25.989170 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-2e07d1e0-aff8-4d2b-84f0-fa0d10a85829 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:25.989905 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-2e07d1e0-aff8-4d2b-84f0-fa0d10a85829 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:25.996347 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2e07d1e0-aff8-4d2b-84f0-fa0d10a85829 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:25.996868 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2e07d1e0-aff8-4d2b-84f0-fa0d10a85829 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:25.997693 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2e07d1e0-aff8-4d2b-84f0-fa0d10a85829 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:25.998426 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2e07d1e0-aff8-4d2b-84f0-fa0d10a85829 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:26.001528 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:26.001528 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:26.032421 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-9c5cd515-d2cf-4b88-a9a0-7b024264fbc0 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "DELETE /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc/os-volume_attachments/e3226124-85f2-46fa-ac19-c03530db7a21" status: 202 len: 0 microversion: 2.1 time: 0.211781 Jul 13 02:30:26.033008 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 294/591] 10.222.0.32 () {58 vars in 1416 bytes} [Tue Jul 13 02:30:25 2021] DELETE /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc/os-volume_attachments/e3226124-85f2-46fa-ac19-c03530db7a21 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:30:26.183448 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-2e07d1e0-aff8-4d2b-84f0-fa0d10a85829 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:26.186059 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:26.186059 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:26.196142 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-2e07d1e0-aff8-4d2b-84f0-fa0d10a85829 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:26.196501 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-e6b664d5-caff-4f75-ad3c-d246e9179ea6 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:26.197118 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-e6b664d5-caff-4f75-ad3c-d246e9179ea6 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d7423adc-bb73-46e2-8ddf-203316b7094a] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:26.198063 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-2e07d1e0-aff8-4d2b-84f0-fa0d10a85829 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:26.199311 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-2e07d1e0-aff8-4d2b-84f0-fa0d10a85829 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1797 microversion: 2.20 time: 0.213823 Jul 13 02:30:26.199852 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 298/592] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:30:25 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1797 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:30:26.203397 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e6b664d5-caff-4f75-ad3c-d246e9179ea6 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:26.203839 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e6b664d5-caff-4f75-ad3c-d246e9179ea6 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:26.204635 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e6b664d5-caff-4f75-ad3c-d246e9179ea6 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:26.205063 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e6b664d5-caff-4f75-ad3c-d246e9179ea6 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:26.208411 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:26.208411 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:26.270425 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-e6b664d5-caff-4f75-ad3c-d246e9179ea6 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d7423adc-bb73-46e2-8ddf-203316b7094a] Going to try to terminate instance {{(pid=107262) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 13 02:30:26.272598 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3008: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:26.272598 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).\ Jul 13 02:30:26.284985 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:26.284985 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:26.345501 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/update_match.py:472: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:26.345501 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = query.session.execute(update_stmt) Jul 13 02:30:26.358639 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:530: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:26.358639 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = model_query(context, models.Service, read_deleted="no").\ Jul 13 02:30:26.392440 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-e6b664d5-caff-4f75-ad3c-d246e9179ea6 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "DELETE /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a" status: 204 len: 0 microversion: 2.1 time: 0.200471 Jul 13 02:30:26.393022 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 295/593] 10.222.0.32 () {58 vars in 1239 bytes} [Tue Jul 13 02:30:26 2021] DELETE /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 13 02:30:26.401031 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-07bb349c-0062-408f-b43d-ca28627fc14f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:26.401354 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-b3d818d3-b9fe-434c-959d-cc56f7fc7ad1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:26.401722 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-07bb349c-0062-408f-b43d-ca28627fc14f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:26.401832 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-b3d818d3-b9fe-434c-959d-cc56f7fc7ad1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d7423adc-bb73-46e2-8ddf-203316b7094a] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:26.407563 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-07bb349c-0062-408f-b43d-ca28627fc14f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:26.408044 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b3d818d3-b9fe-434c-959d-cc56f7fc7ad1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:26.408643 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-07bb349c-0062-408f-b43d-ca28627fc14f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:26.408763 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b3d818d3-b9fe-434c-959d-cc56f7fc7ad1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:26.409288 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-07bb349c-0062-408f-b43d-ca28627fc14f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:26.409739 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-07bb349c-0062-408f-b43d-ca28627fc14f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:26.410287 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b3d818d3-b9fe-434c-959d-cc56f7fc7ad1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:26.410724 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b3d818d3-b9fe-434c-959d-cc56f7fc7ad1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:26.413255 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:26.413255 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:26.414378 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:26.414378 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:26.439082 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 13 02:30:26.445376 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: Tue Jul 13 02:30:26 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 (ip 10.222.0.32) !!! Jul 13 02:30:26.670473 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-b3d818d3-b9fe-434c-959d-cc56f7fc7ad1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:26.671773 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-07bb349c-0062-408f-b43d-ca28627fc14f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:26.673267 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:26.673267 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:26.674525 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:26.674525 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:26.680813 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-b3d818d3-b9fe-434c-959d-cc56f7fc7ad1 tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a" status: 200 len: 1514 microversion: 2.1 time: 0.283448 Jul 13 02:30:26.681703 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 299/594] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:26 2021] GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a => generated 1514 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:26.681854 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-07bb349c-0062-408f-b43d-ca28627fc14f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1678 microversion: 2.1 time: 0.284515 Jul 13 02:30:26.691205 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 296/595] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:26 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1678 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:26.693735 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [req-a0e572e8-2019-4fe1-9a2d-3a14afdecb31 req-47bded86-198d-4638-bf71-703b95684f10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "872b8d83-fdcf-4888-b1d3-64f49541426d", "name": "network-vif-plugged", "status": "completed", "tag": "49588aa8-e16a-42d4-9d7e-8c1cf67a6211"}]} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:30:26.695602 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:30:26.695602 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: warnings.warn(msg) Jul 13 02:30:26.702361 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-a0e572e8-2019-4fe1-9a2d-3a14afdecb31 req-47bded86-198d-4638-bf71-703b95684f10 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:26.702808 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-a0e572e8-2019-4fe1-9a2d-3a14afdecb31 req-47bded86-198d-4638-bf71-703b95684f10 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:26.714229 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.compute.server_external_events [req-a0e572e8-2019-4fe1-9a2d-3a14afdecb31 req-47bded86-198d-4638-bf71-703b95684f10 service nova] Creating event network-vif-plugged:49588aa8-e16a-42d4-9d7e-8c1cf67a6211 for instance 872b8d83-fdcf-4888-b1d3-64f49541426d on hv-cinder-78102 Jul 13 02:30:26.718791 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [req-a0e572e8-2019-4fe1-9a2d-3a14afdecb31 req-47bded86-198d-4638-bf71-703b95684f10 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029034 Jul 13 02:30:26.719353 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 300/596] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:30:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:30:26.840222 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-9b134cf9-1c3f-471f-86c6-3439fa16041c tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:26.841119 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-9b134cf9-1c3f-471f-86c6-3439fa16041c tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 325ba981-747f-4908-a6d4-529a36297483] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:26.847087 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9b134cf9-1c3f-471f-86c6-3439fa16041c tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:26.847474 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9b134cf9-1c3f-471f-86c6-3439fa16041c tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:26.848238 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9b134cf9-1c3f-471f-86c6-3439fa16041c tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:26.848688 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9b134cf9-1c3f-471f-86c6-3439fa16041c tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:26.851589 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:26.851589 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:27.028355 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-9b134cf9-1c3f-471f-86c6-3439fa16041c tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21025e2c8aa9423dbd05da95f237b481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2c1d46685432e8656123be9d86664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:27.030916 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:27.030916 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:27.037886 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-9b134cf9-1c3f-471f-86c6-3439fa16041c tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "GET /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483" status: 200 len: 1508 microversion: 2.1 time: 0.201381 Jul 13 02:30:27.038489 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 297/597] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:26 2021] GET /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483 => generated 1508 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:27.055057 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-fda141e6-f088-4376-b680-c0e02dfd7815 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9052ce2e-0de2-46e6-a2ab-36c261438353", "device": "/dev/sdb"}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:30:27.056683 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-fda141e6-f088-4376-b680-c0e02dfd7815 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 325ba981-747f-4908-a6d4-529a36297483] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:27.062777 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-fda141e6-f088-4376-b680-c0e02dfd7815 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:27.063222 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-fda141e6-f088-4376-b680-c0e02dfd7815 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:27.063979 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-fda141e6-f088-4376-b680-c0e02dfd7815 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:27.064408 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-fda141e6-f088-4376-b680-c0e02dfd7815 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:27.067031 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:27.067031 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:27.183871 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3019: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:27.183871 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context, Jul 13 02:30:27.263540 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2940: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:27.263540 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: query.update(values) Jul 13 02:30:27.265850 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2941: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:27.265850 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return query.first() Jul 13 02:30:27.363044 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2940: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:27.363044 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: query.update(values) Jul 13 02:30:27.366569 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2941: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:27.366569 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return query.first() Jul 13 02:30:27.388582 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-fda141e6-f088-4376-b680-c0e02dfd7815 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "POST /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.337487 Jul 13 02:30:27.389490 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 301/598] 10.222.0.32 () {60 vars in 1323 bytes} [Tue Jul 13 02:30:27 2021] POST /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483/os-volume_attachments => generated 194 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:30:27.698614 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-572c06ad-1142-4b18-bf2c-6d314cf904bd tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:27.699222 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-572c06ad-1142-4b18-bf2c-6d314cf904bd tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d7423adc-bb73-46e2-8ddf-203316b7094a] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:27.701916 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-28f74ab2-d4b3-418a-93df-dc71fd9b6a93 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:27.702717 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-28f74ab2-d4b3-418a-93df-dc71fd9b6a93 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:27.706498 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-572c06ad-1142-4b18-bf2c-6d314cf904bd tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:27.706946 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-572c06ad-1142-4b18-bf2c-6d314cf904bd tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:27.707733 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-572c06ad-1142-4b18-bf2c-6d314cf904bd tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:27.708196 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-572c06ad-1142-4b18-bf2c-6d314cf904bd tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:27.711622 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:27.711622 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:27.713317 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-28f74ab2-d4b3-418a-93df-dc71fd9b6a93 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:27.713767 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-28f74ab2-d4b3-418a-93df-dc71fd9b6a93 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:27.715960 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-28f74ab2-d4b3-418a-93df-dc71fd9b6a93 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:27.716406 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-28f74ab2-d4b3-418a-93df-dc71fd9b6a93 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:27.719593 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:27.719593 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:27.963726 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-28f74ab2-d4b3-418a-93df-dc71fd9b6a93 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:27.966336 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:27.966336 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:27.969045 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-572c06ad-1142-4b18-bf2c-6d314cf904bd tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:27.971501 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:27.971501 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:27.974499 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-28f74ab2-d4b3-418a-93df-dc71fd9b6a93 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1678 microversion: 2.1 time: 0.276194 Jul 13 02:30:27.975331 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 302/599] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:27 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1678 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:30:27.981224 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-572c06ad-1142-4b18-bf2c-6d314cf904bd tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a" status: 200 len: 1514 microversion: 2.1 time: 0.286232 Jul 13 02:30:27.981791 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 298/600] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:27 2021] GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a => generated 1514 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:28.992194 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-7cb21bbc-f77a-47f3-8777-49ac6cb159d5 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:28.993566 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-7cb21bbc-f77a-47f3-8777-49ac6cb159d5 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:28.998618 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-ceb5c774-622a-4023-825a-7f6908f3fdcc tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:29.000819 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7cb21bbc-f77a-47f3-8777-49ac6cb159d5 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:29.001050 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-ceb5c774-622a-4023-825a-7f6908f3fdcc tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d7423adc-bb73-46e2-8ddf-203316b7094a] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:29.001278 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7cb21bbc-f77a-47f3-8777-49ac6cb159d5 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:29.003330 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7cb21bbc-f77a-47f3-8777-49ac6cb159d5 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:29.003866 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7cb21bbc-f77a-47f3-8777-49ac6cb159d5 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:29.010522 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:29.010522 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:29.010795 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ceb5c774-622a-4023-825a-7f6908f3fdcc tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:29.010795 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ceb5c774-622a-4023-825a-7f6908f3fdcc tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:29.010966 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ceb5c774-622a-4023-825a-7f6908f3fdcc tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:29.011296 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ceb5c774-622a-4023-825a-7f6908f3fdcc tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:29.015810 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:29.015810 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:29.159998 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-ceb5c774-622a-4023-825a-7f6908f3fdcc tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f236dcca98c04f60aa827231eede0815', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b3bcc4decdb4d42a7f3efd99887e102', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:29.162804 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:29.162804 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:29.169844 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-ceb5c774-622a-4023-825a-7f6908f3fdcc tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a" status: 200 len: 1472 microversion: 2.1 time: 0.174785 Jul 13 02:30:29.170771 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 299/601] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:28 2021] GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a => generated 1472 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:29.283643 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-6ca71be0-0b81-4aa8-808d-fdf8cf3c321c req-86cf7a5d-9fbd-4f96-ab11-424eeb2022ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7423adc-bb73-46e2-8ddf-203316b7094a", "name": "network-vif-deleted", "tag": "169b5bff-c716-4a28-9ed0-c59c69e1f08b"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:30:29.285443 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:30:29.285443 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:30:29.309346 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-6ca71be0-0b81-4aa8-808d-fdf8cf3c321c req-86cf7a5d-9fbd-4f96-ab11-424eeb2022ad service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:29.310056 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-6ca71be0-0b81-4aa8-808d-fdf8cf3c321c req-86cf7a5d-9fbd-4f96-ab11-424eeb2022ad service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:29.323717 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-7cb21bbc-f77a-47f3-8777-49ac6cb159d5 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:29.326959 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:29.326959 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:29.337197 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-6ca71be0-0b81-4aa8-808d-fdf8cf3c321c req-86cf7a5d-9fbd-4f96-ab11-424eeb2022ad service nova] Creating event network-vif-deleted:169b5bff-c716-4a28-9ed0-c59c69e1f08b for instance d7423adc-bb73-46e2-8ddf-203316b7094a on hv-cinder-78102 Jul 13 02:30:29.339507 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-7cb21bbc-f77a-47f3-8777-49ac6cb159d5 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1678 microversion: 2.1 time: 0.349271 Jul 13 02:30:29.342770 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-6ca71be0-0b81-4aa8-808d-fdf8cf3c321c req-86cf7a5d-9fbd-4f96-ab11-424eeb2022ad service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064002 Jul 13 02:30:29.348597 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 300/602] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:30:29 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:30:29.349990 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 303/603] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:28 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1678 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:30.186858 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-a3dcc695-cf6f-4d02-84ef-fe45a9946a0a tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:30.187557 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-a3dcc695-cf6f-4d02-84ef-fe45a9946a0a tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] [instance: d7423adc-bb73-46e2-8ddf-203316b7094a] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:30.193795 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a3dcc695-cf6f-4d02-84ef-fe45a9946a0a tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:30.194307 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a3dcc695-cf6f-4d02-84ef-fe45a9946a0a tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:30.195085 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a3dcc695-cf6f-4d02-84ef-fe45a9946a0a tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:30.195519 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a3dcc695-cf6f-4d02-84ef-fe45a9946a0a tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:30.198669 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:30.198669 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:30.244212 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.wsgi [None req-a3dcc695-cf6f-4d02-84ef-fe45a9946a0a tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] HTTP exception thrown: Instance d7423adc-bb73-46e2-8ddf-203316b7094a could not be found. Jul 13 02:30:30.244819 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-a3dcc695-cf6f-4d02-84ef-fe45a9946a0a tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] Returning 404 to user: Instance d7423adc-bb73-46e2-8ddf-203316b7094a could not be found. {{(pid=107262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:30:30.245656 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-a3dcc695-cf6f-4d02-84ef-fe45a9946a0a tempest-AttachVolumeNegativeTest-1676311495 tempest-AttachVolumeNegativeTest-1676311495-project] 10.222.0.32 "GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a" status: 404 len: 111 microversion: 2.1 time: 0.062900 Jul 13 02:30:30.246238 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 301/604] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:30 2021] GET /compute/v2.1/servers/d7423adc-bb73-46e2-8ddf-203316b7094a => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 02:30:30.357991 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-7a3404c5-a3d2-486d-b541-b9b01036da39 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:30.358581 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-7a3404c5-a3d2-486d-b541-b9b01036da39 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:30.364621 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7a3404c5-a3d2-486d-b541-b9b01036da39 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:30.365248 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7a3404c5-a3d2-486d-b541-b9b01036da39 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:30.366521 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7a3404c5-a3d2-486d-b541-b9b01036da39 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:30.367038 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7a3404c5-a3d2-486d-b541-b9b01036da39 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:30.370492 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:30.370492 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:30.507330 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-4b53c896-27bb-4429-b6de-13ebd9b86418 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:30.509215 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-4b53c896-27bb-4429-b6de-13ebd9b86418 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:30.517006 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-4b53c896-27bb-4429-b6de-13ebd9b86418 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:30.517666 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-4b53c896-27bb-4429-b6de-13ebd9b86418 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:30.518510 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-4b53c896-27bb-4429-b6de-13ebd9b86418 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:30.519145 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-4b53c896-27bb-4429-b6de-13ebd9b86418 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:30.523411 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:30.523411 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:30.582993 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-7a3404c5-a3d2-486d-b541-b9b01036da39 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:30.587084 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:30.587084 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:30.596759 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-7a3404c5-a3d2-486d-b541-b9b01036da39 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1678 microversion: 2.1 time: 0.243463 Jul 13 02:30:30.609996 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 304/605] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:30 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1678 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:30.617441 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-4b53c896-27bb-4429-b6de-13ebd9b86418 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Going to try to terminate instance {{(pid=107262) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 13 02:30:30.621470 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3008: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:30.621470 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).\ Jul 13 02:30:30.636317 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:30.636317 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:30.698405 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/update_match.py:472: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:30.698405 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = query.session.execute(update_stmt) Jul 13 02:30:30.719335 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:530: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:30.719335 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = model_query(context, models.Service, read_deleted="no").\ Jul 13 02:30:30.759560 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-4b53c896-27bb-4429-b6de-13ebd9b86418 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "DELETE /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 204 len: 0 microversion: 2.1 time: 0.259107 Jul 13 02:30:30.760458 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 302/606] 10.222.0.32 () {58 vars in 1239 bytes} [Tue Jul 13 02:30:30 2021] DELETE /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 13 02:30:30.771334 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-04679a0a-0c60-4fdf-a31e-17505f99fe16 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:30.772188 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-04679a0a-0c60-4fdf-a31e-17505f99fe16 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:30.784011 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-04679a0a-0c60-4fdf-a31e-17505f99fe16 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:30.784455 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-04679a0a-0c60-4fdf-a31e-17505f99fe16 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:30.785336 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-04679a0a-0c60-4fdf-a31e-17505f99fe16 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:30.785676 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-04679a0a-0c60-4fdf-a31e-17505f99fe16 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:30.792331 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:30.792331 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:30.991146 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-04679a0a-0c60-4fdf-a31e-17505f99fe16 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:30.993881 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:30.993881 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:31.003102 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-04679a0a-0c60-4fdf-a31e-17505f99fe16 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1507 microversion: 2.1 time: 0.237168 Jul 13 02:30:31.003956 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 305/607] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:30 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1507 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:31.616770 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-3fe3d17b-008a-49ff-96e8-06acf8240ccf tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:31.617481 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-3fe3d17b-008a-49ff-96e8-06acf8240ccf tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:31.624555 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3fe3d17b-008a-49ff-96e8-06acf8240ccf tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:31.625034 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3fe3d17b-008a-49ff-96e8-06acf8240ccf tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:31.625825 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3fe3d17b-008a-49ff-96e8-06acf8240ccf tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:31.626328 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3fe3d17b-008a-49ff-96e8-06acf8240ccf tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:31.629741 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:31.629741 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:31.879248 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-3fe3d17b-008a-49ff-96e8-06acf8240ccf tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:31.883629 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:31.883629 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:31.896174 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-3fe3d17b-008a-49ff-96e8-06acf8240ccf tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1678 microversion: 2.1 time: 0.284719 Jul 13 02:30:31.897393 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 303/608] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:31 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1678 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:30:32.020707 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-6d48bd80-c604-4064-ac73-e560eafc3711 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:32.022337 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-6d48bd80-c604-4064-ac73-e560eafc3711 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:32.031780 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-6d48bd80-c604-4064-ac73-e560eafc3711 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:32.032603 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-6d48bd80-c604-4064-ac73-e560eafc3711 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:32.033549 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-6d48bd80-c604-4064-ac73-e560eafc3711 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:32.034202 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-6d48bd80-c604-4064-ac73-e560eafc3711 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:32.038694 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:32.038694 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:32.181172 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-1dad0af6-9a91-4518-88a7-4e6e58c09509 tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] Action: 'create', calling method: .version_select at 0x7f4313937430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-90187069"}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:30:32.247569 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-6d48bd80-c604-4064-ac73-e560eafc3711 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:32.249900 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:32.249900 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:32.257983 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-6d48bd80-c604-4064-ac73-e560eafc3711 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1507 microversion: 2.1 time: 0.240878 Jul 13 02:30:32.260261 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 304/609] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:32 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1507 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:30:32.495687 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-1dad0af6-9a91-4518-88a7-4e6e58c09509 tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 0.481641 Jul 13 02:30:32.496615 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 306/610] 10.222.0.32 () {60 vars in 1155 bytes} [Tue Jul 13 02:30:32 2021] POST /compute/v2.1/os-volumes => generated 343 bytes in 483 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 13 02:30:32.509539 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-d5e9f053-0f27-4540-ba66-1fef9450188e tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] Calling method '.version_select at 0x7f43139301f0>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:32.564471 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-d5e9f053-0f27-4540-ba66-1fef9450188e tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/fb5d7cdd-d28e-4980-8717-000ed531980b" status: 200 len: 343 microversion: 2.1 time: 0.060957 Jul 13 02:30:32.565045 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 305/611] 10.222.0.32 () {58 vars in 1245 bytes} [Tue Jul 13 02:30:32 2021] GET /compute/v2.1/os-volumes/fb5d7cdd-d28e-4980-8717-000ed531980b => generated 343 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:30:32.915581 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-0ad45c0d-5a8a-4461-a24b-98bb0bf93537 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:32.916189 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-0ad45c0d-5a8a-4461-a24b-98bb0bf93537 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:32.922286 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0ad45c0d-5a8a-4461-a24b-98bb0bf93537 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:32.922736 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0ad45c0d-5a8a-4461-a24b-98bb0bf93537 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:32.923506 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0ad45c0d-5a8a-4461-a24b-98bb0bf93537 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:32.923939 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0ad45c0d-5a8a-4461-a24b-98bb0bf93537 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:32.927436 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:32.927436 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:33.104184 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-0ad45c0d-5a8a-4461-a24b-98bb0bf93537 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:33.107640 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:33.107640 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:33.114966 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-0ad45c0d-5a8a-4461-a24b-98bb0bf93537 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1678 microversion: 2.1 time: 0.202849 Jul 13 02:30:33.115227 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 307/612] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:32 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1678 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:30:33.276568 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-67a910b5-67dc-486a-9681-3c000cd10a03 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:33.277172 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-67a910b5-67dc-486a-9681-3c000cd10a03 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:33.283376 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-67a910b5-67dc-486a-9681-3c000cd10a03 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:33.283824 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-67a910b5-67dc-486a-9681-3c000cd10a03 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:33.284596 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-67a910b5-67dc-486a-9681-3c000cd10a03 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:33.285032 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-67a910b5-67dc-486a-9681-3c000cd10a03 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:33.288421 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:33.288421 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:33.501084 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-67a910b5-67dc-486a-9681-3c000cd10a03 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:33.504222 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:33.504222 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:33.513731 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-67a910b5-67dc-486a-9681-3c000cd10a03 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1507 microversion: 2.1 time: 0.240694 Jul 13 02:30:33.514656 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 306/613] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:33 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1507 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:33.576644 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-d02383a5-f1aa-469c-95d7-5b04dfc53613 tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] Calling method '.version_select at 0x7f4312f66430>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:33.638372 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-d02383a5-f1aa-469c-95d7-5b04dfc53613 tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/fb5d7cdd-d28e-4980-8717-000ed531980b" status: 200 len: 344 microversion: 2.1 time: 0.065100 Jul 13 02:30:33.639124 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 308/614] 10.222.0.32 () {58 vars in 1245 bytes} [Tue Jul 13 02:30:33 2021] GET /compute/v2.1/os-volumes/fb5d7cdd-d28e-4980-8717-000ed531980b => generated 344 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:30:33.650184 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-873f54a3-0ca0-4d01-88fd-93fa1748a649 tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] Action: 'create', calling method: .version_select at 0x7f4314212550>, body: {"snapshot": {"volume_id": "fb5d7cdd-d28e-4980-8717-000ed531980b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-65681432"}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:30:33.835424 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-873f54a3-0ca0-4d01-88fd-93fa1748a649 tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] 10.222.0.32 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.189090 Jul 13 02:30:33.836015 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 307/615] 10.222.0.32 () {60 vars in 1162 bytes} [Tue Jul 13 02:30:33 2021] POST /compute/v2.1/os-snapshots => generated 285 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 02:30:33.848430 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-39b497ed-802d-4914-a329-4bc0b39545d6 tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] Calling method '.version_select at 0x7f4312c199d0>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:33.892290 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-39b497ed-802d-4914-a329-4bc0b39545d6 tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/a599c1ec-178c-4154-92cf-c60123ecd63b" status: 200 len: 285 microversion: 2.1 time: 0.049742 Jul 13 02:30:33.892974 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 309/616] 10.222.0.32 () {58 vars in 1251 bytes} [Tue Jul 13 02:30:33 2021] GET /compute/v2.1/os-snapshots/a599c1ec-178c-4154-92cf-c60123ecd63b => generated 285 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:30:33.903975 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-88f1583e-1953-48fd-afa5-44ee3f31f1e8 tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] Calling method '.version_select at 0x7f43126ff700>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:33.939172 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-88f1583e-1953-48fd-afa5-44ee3f31f1e8 tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.039030 Jul 13 02:30:33.949970 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-30f7f2d2-63f9-4015-8b15-f2fb990bbdf6 tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] Calling method '.version_select at 0x7f4312ea3670>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:33.950857 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 308/617] 10.222.0.32 () {58 vars in 1140 bytes} [Tue Jul 13 02:30:33 2021] GET /compute/v2.1/os-snapshots => generated 288 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:30:34.001556 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-30f7f2d2-63f9-4015-8b15-f2fb990bbdf6 tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/a599c1ec-178c-4154-92cf-c60123ecd63b" status: 200 len: 285 microversion: 2.1 time: 0.053236 Jul 13 02:30:34.002586 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 310/618] 10.222.0.32 () {58 vars in 1251 bytes} [Tue Jul 13 02:30:33 2021] GET /compute/v2.1/os-snapshots/a599c1ec-178c-4154-92cf-c60123ecd63b => generated 285 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:30:34.027251 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-95e1af86-562a-47ca-b8ac-6cdd8054f187 req-d072cf92-07c5-497f-9ec1-38148f8248a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc5604ab-b605-4558-93e4-81a91df55684", "name": "network-vif-deleted", "tag": "60c4d5a2-781e-4a87-a16c-c361e468e5ad"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:30:34.028876 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:30:34.028876 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:30:34.038061 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-95e1af86-562a-47ca-b8ac-6cdd8054f187 req-d072cf92-07c5-497f-9ec1-38148f8248a5 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:34.041209 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-95e1af86-562a-47ca-b8ac-6cdd8054f187 req-d072cf92-07c5-497f-9ec1-38148f8248a5 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:34.054287 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-95e1af86-562a-47ca-b8ac-6cdd8054f187 req-d072cf92-07c5-497f-9ec1-38148f8248a5 service nova] Creating event network-vif-deleted:60c4d5a2-781e-4a87-a16c-c361e468e5ad for instance fc5604ab-b605-4558-93e4-81a91df55684 on hv-cinder-78102 Jul 13 02:30:34.060673 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-95e1af86-562a-47ca-b8ac-6cdd8054f187 req-d072cf92-07c5-497f-9ec1-38148f8248a5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037798 Jul 13 02:30:34.061827 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 309/619] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:30:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:30:34.131555 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-9e5fb772-6dc3-4cfe-8783-0a16150cf52b tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:34.132205 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-9e5fb772-6dc3-4cfe-8783-0a16150cf52b tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:34.144615 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-9e5fb772-6dc3-4cfe-8783-0a16150cf52b tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:34.145074 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-9e5fb772-6dc3-4cfe-8783-0a16150cf52b tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:34.146445 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-9e5fb772-6dc3-4cfe-8783-0a16150cf52b tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:34.146975 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-9e5fb772-6dc3-4cfe-8783-0a16150cf52b tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:34.154869 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:34.154869 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:34.339518 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-9e5fb772-6dc3-4cfe-8783-0a16150cf52b tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:34.342209 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:34.342209 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:34.349346 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-9e5fb772-6dc3-4cfe-8783-0a16150cf52b tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1678 microversion: 2.1 time: 0.222055 Jul 13 02:30:34.349915 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 311/620] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:34 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1678 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:34.530696 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-d27ee0ee-9137-4dd9-84ef-0497cbe73de9 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:34.531390 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-d27ee0ee-9137-4dd9-84ef-0497cbe73de9 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:34.538467 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d27ee0ee-9137-4dd9-84ef-0497cbe73de9 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:34.538919 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d27ee0ee-9137-4dd9-84ef-0497cbe73de9 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:34.539690 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d27ee0ee-9137-4dd9-84ef-0497cbe73de9 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:34.540127 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d27ee0ee-9137-4dd9-84ef-0497cbe73de9 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:34.543049 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:34.543049 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:34.613836 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d27ee0ee-9137-4dd9-84ef-0497cbe73de9 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:34.614364 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d27ee0ee-9137-4dd9-84ef-0497cbe73de9 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:34.615371 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.objects.instance [None req-d27ee0ee-9137-4dd9-84ef-0497cbe73de9 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lazy-loading 'fault' on Instance uuid fc5604ab-b605-4558-93e4-81a91df55684 {{(pid=107262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 13 02:30:34.617378 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:4002: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:34.617378 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: for row in query: Jul 13 02:30:34.664239 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-d27ee0ee-9137-4dd9-84ef-0497cbe73de9 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:34.666831 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:34.666831 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:34.673990 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-d27ee0ee-9137-4dd9-84ef-0497cbe73de9 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1311 microversion: 2.1 time: 0.147283 Jul 13 02:30:34.674939 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 310/621] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:34 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1311 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:35.013324 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-b49fa083-90f7-4353-8bde-7242145ec8db tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] Calling method '.version_select at 0x7f4313937e50>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:35.043559 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-b49fa083-90f7-4353-8bde-7242145ec8db tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/a599c1ec-178c-4154-92cf-c60123ecd63b" status: 200 len: 285 microversion: 2.1 time: 0.034217 Jul 13 02:30:35.044405 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 312/622] 10.222.0.32 () {58 vars in 1251 bytes} [Tue Jul 13 02:30:35 2021] GET /compute/v2.1/os-snapshots/a599c1ec-178c-4154-92cf-c60123ecd63b => generated 285 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:30:35.366805 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-870700e3-a7fc-413d-917e-98a455e2d69d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:35.367486 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-870700e3-a7fc-413d-917e-98a455e2d69d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:35.373440 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-870700e3-a7fc-413d-917e-98a455e2d69d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:35.373880 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-870700e3-a7fc-413d-917e-98a455e2d69d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:35.374669 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-870700e3-a7fc-413d-917e-98a455e2d69d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:35.375094 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-870700e3-a7fc-413d-917e-98a455e2d69d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:35.377843 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:35.377843 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:35.549682 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-870700e3-a7fc-413d-917e-98a455e2d69d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:35.552470 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:35.552470 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:35.559446 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-870700e3-a7fc-413d-917e-98a455e2d69d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1678 microversion: 2.1 time: 0.196790 Jul 13 02:30:35.560005 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 311/623] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:35 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1678 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:35.690932 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-5fa61a37-c3d9-4f57-9ba4-0e2f137821e8 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:35.691532 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-5fa61a37-c3d9-4f57-9ba4-0e2f137821e8 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:35.697329 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5fa61a37-c3d9-4f57-9ba4-0e2f137821e8 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:35.697771 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5fa61a37-c3d9-4f57-9ba4-0e2f137821e8 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:35.698561 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5fa61a37-c3d9-4f57-9ba4-0e2f137821e8 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:35.698991 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5fa61a37-c3d9-4f57-9ba4-0e2f137821e8 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:35.701820 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:35.701820 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:35.772688 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5fa61a37-c3d9-4f57-9ba4-0e2f137821e8 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:35.773057 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5fa61a37-c3d9-4f57-9ba4-0e2f137821e8 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:35.773497 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.objects.instance [None req-5fa61a37-c3d9-4f57-9ba4-0e2f137821e8 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lazy-loading 'fault' on Instance uuid fc5604ab-b605-4558-93e4-81a91df55684 {{(pid=107263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 13 02:30:35.775432 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:4002: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:35.775432 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: for row in query: Jul 13 02:30:35.816702 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-5fa61a37-c3d9-4f57-9ba4-0e2f137821e8 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:35.819394 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:35.819394 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:35.826148 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-5fa61a37-c3d9-4f57-9ba4-0e2f137821e8 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1311 microversion: 2.1 time: 0.138829 Jul 13 02:30:35.826703 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 313/624] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:35 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1311 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:36.055002 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-cf096fea-220d-4c73-aee6-c395bfc8fa5b tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] Calling method '.version_select at 0x7f4313066550>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:36.085771 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-cf096fea-220d-4c73-aee6-c395bfc8fa5b tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/a599c1ec-178c-4154-92cf-c60123ecd63b" status: 200 len: 285 microversion: 2.1 time: 0.034702 Jul 13 02:30:36.086351 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 312/625] 10.222.0.32 () {58 vars in 1251 bytes} [Tue Jul 13 02:30:36 2021] GET /compute/v2.1/os-snapshots/a599c1ec-178c-4154-92cf-c60123ecd63b => generated 285 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:30:36.575238 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-0d066500-4e68-4ddf-9c24-8977e52c6a3f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:36.575849 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-0d066500-4e68-4ddf-9c24-8977e52c6a3f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:36.581732 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0d066500-4e68-4ddf-9c24-8977e52c6a3f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:36.582213 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0d066500-4e68-4ddf-9c24-8977e52c6a3f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:36.583037 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0d066500-4e68-4ddf-9c24-8977e52c6a3f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:36.583467 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0d066500-4e68-4ddf-9c24-8977e52c6a3f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:36.586332 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:36.586332 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:36.758139 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-0d066500-4e68-4ddf-9c24-8977e52c6a3f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:36.760737 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:36.760737 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:36.767803 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-0d066500-4e68-4ddf-9c24-8977e52c6a3f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1678 microversion: 2.1 time: 0.196248 Jul 13 02:30:36.768369 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 314/626] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:36 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1678 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:36.843408 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-7f0bd9a5-bd71-4649-95f4-85eceef044bf tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:36.843960 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-7f0bd9a5-bd71-4649-95f4-85eceef044bf tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:36.851199 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7f0bd9a5-bd71-4649-95f4-85eceef044bf tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:36.851641 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7f0bd9a5-bd71-4649-95f4-85eceef044bf tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:36.852407 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7f0bd9a5-bd71-4649-95f4-85eceef044bf tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:36.852834 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7f0bd9a5-bd71-4649-95f4-85eceef044bf tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:36.856036 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:36.856036 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:36.929048 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7f0bd9a5-bd71-4649-95f4-85eceef044bf tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:36.929495 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7f0bd9a5-bd71-4649-95f4-85eceef044bf tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:36.929939 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.objects.instance [None req-7f0bd9a5-bd71-4649-95f4-85eceef044bf tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lazy-loading 'fault' on Instance uuid fc5604ab-b605-4558-93e4-81a91df55684 {{(pid=107262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 13 02:30:36.931878 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:4002: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:36.931878 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: for row in query: Jul 13 02:30:36.972114 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-7f0bd9a5-bd71-4649-95f4-85eceef044bf tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:36.975464 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:36.975464 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:36.982511 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-7f0bd9a5-bd71-4649-95f4-85eceef044bf tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 200 len: 1311 microversion: 2.1 time: 0.142869 Jul 13 02:30:36.983074 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 313/627] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:36 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 1311 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:37.097471 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-71686293-0cf6-426f-8030-971234610248 tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] Calling method '.version_select at 0x7f4312c19c10>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:37.150366 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-71686293-0cf6-426f-8030-971234610248 tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/a599c1ec-178c-4154-92cf-c60123ecd63b" status: 200 len: 285 microversion: 2.1 time: 0.057529 Jul 13 02:30:37.150924 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 315/628] 10.222.0.32 () {58 vars in 1251 bytes} [Tue Jul 13 02:30:37 2021] GET /compute/v2.1/os-snapshots/a599c1ec-178c-4154-92cf-c60123ecd63b => generated 285 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:30:37.784816 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-8ffef812-3a6f-4b6d-88cc-f90353e8f232 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:37.785338 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-8ffef812-3a6f-4b6d-88cc-f90353e8f232 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:37.791861 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8ffef812-3a6f-4b6d-88cc-f90353e8f232 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:37.792329 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8ffef812-3a6f-4b6d-88cc-f90353e8f232 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:37.793086 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8ffef812-3a6f-4b6d-88cc-f90353e8f232 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:37.793543 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8ffef812-3a6f-4b6d-88cc-f90353e8f232 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:37.796394 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:37.796394 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:37.969236 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-8ffef812-3a6f-4b6d-88cc-f90353e8f232 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:37.971894 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:37.971894 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:37.979179 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-8ffef812-3a6f-4b6d-88cc-f90353e8f232 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1678 microversion: 2.1 time: 0.198163 Jul 13 02:30:37.979733 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 314/629] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:37 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1678 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:37.999437 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-25b781aa-d3dd-42eb-b7a6-1af965c4c5ac tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:38.000037 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-25b781aa-d3dd-42eb-b7a6-1af965c4c5ac tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: fc5604ab-b605-4558-93e4-81a91df55684] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:38.007049 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-25b781aa-d3dd-42eb-b7a6-1af965c4c5ac tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:38.007491 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-25b781aa-d3dd-42eb-b7a6-1af965c4c5ac tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:38.008249 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-25b781aa-d3dd-42eb-b7a6-1af965c4c5ac tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:38.008676 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-25b781aa-d3dd-42eb-b7a6-1af965c4c5ac tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:38.011760 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:38.011760 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:38.056946 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.wsgi [None req-25b781aa-d3dd-42eb-b7a6-1af965c4c5ac tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] HTTP exception thrown: Instance fc5604ab-b605-4558-93e4-81a91df55684 could not be found. Jul 13 02:30:38.057462 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-25b781aa-d3dd-42eb-b7a6-1af965c4c5ac tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Returning 404 to user: Instance fc5604ab-b605-4558-93e4-81a91df55684 could not be found. {{(pid=107263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:30:38.058306 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-25b781aa-d3dd-42eb-b7a6-1af965c4c5ac tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684" status: 404 len: 111 microversion: 2.1 time: 0.062527 Jul 13 02:30:38.058835 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 316/630] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:37 2021] GET /compute/v2.1/servers/fc5604ab-b605-4558-93e4-81a91df55684 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 02:30:38.066666 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-b0ad39b5-9d5d-4cb8-8e57-9948c1ff5fba tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:38.067161 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-b0ad39b5-9d5d-4cb8-8e57-9948c1ff5fba tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:38.073154 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b0ad39b5-9d5d-4cb8-8e57-9948c1ff5fba tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:38.073602 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b0ad39b5-9d5d-4cb8-8e57-9948c1ff5fba tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:38.074431 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b0ad39b5-9d5d-4cb8-8e57-9948c1ff5fba tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:38.074895 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b0ad39b5-9d5d-4cb8-8e57-9948c1ff5fba tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:38.077848 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:38.077848 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:38.144546 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-b0ad39b5-9d5d-4cb8-8e57-9948c1ff5fba tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Going to try to terminate instance {{(pid=107262) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 13 02:30:38.146838 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3008: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:38.146838 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).\ Jul 13 02:30:38.159515 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:38.159515 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:38.162116 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-5f83298a-e848-46e8-aef2-4c6ab9291f70 tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] Calling method '.version_select at 0x7f4313808a60>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:38.193765 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-5f83298a-e848-46e8-aef2-4c6ab9291f70 tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/a599c1ec-178c-4154-92cf-c60123ecd63b" status: 200 len: 286 microversion: 2.1 time: 0.035550 Jul 13 02:30:38.194994 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 317/631] 10.222.0.32 () {58 vars in 1251 bytes} [Tue Jul 13 02:30:38 2021] GET /compute/v2.1/os-snapshots/a599c1ec-178c-4154-92cf-c60123ecd63b => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 02:30:38.204570 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-01a53659-2c5a-415e-b590-2faf5d8e16cf tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] Calling method '.version_select at 0x7f4312c19280>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:38.219226 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/update_match.py:472: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:38.219226 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = query.session.execute(update_stmt) Jul 13 02:30:38.233524 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:530: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:38.233524 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = model_query(context, models.Service, read_deleted="no").\ Jul 13 02:30:38.268754 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-b0ad39b5-9d5d-4cb8-8e57-9948c1ff5fba tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "DELETE /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 204 len: 0 microversion: 2.1 time: 0.204731 Jul 13 02:30:38.270095 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 315/632] 10.222.0.32 () {58 vars in 1239 bytes} [Tue Jul 13 02:30:38 2021] DELETE /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 13 02:30:38.282046 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-1eba3aa2-b273-43ff-a40d-891eecb76944 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:38.282843 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-1eba3aa2-b273-43ff-a40d-891eecb76944 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:38.286195 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-01a53659-2c5a-415e-b590-2faf5d8e16cf tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] 10.222.0.32 "DELETE /compute/v2.1/os-snapshots/a599c1ec-178c-4154-92cf-c60123ecd63b" status: 202 len: 0 microversion: 2.1 time: 0.084218 Jul 13 02:30:38.287732 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 318/633] 10.222.0.32 () {58 vars in 1254 bytes} [Tue Jul 13 02:30:38 2021] DELETE /compute/v2.1/os-snapshots/a599c1ec-178c-4154-92cf-c60123ecd63b => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 13 02:30:38.291503 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1eba3aa2-b273-43ff-a40d-891eecb76944 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:38.291999 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1eba3aa2-b273-43ff-a40d-891eecb76944 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:38.293460 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1eba3aa2-b273-43ff-a40d-891eecb76944 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:38.293460 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1eba3aa2-b273-43ff-a40d-891eecb76944 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:38.296298 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-11bcc378-f0b3-4bf4-b347-37748ed54df1 tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] Calling method '.version_select at 0x7f4312de1790>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:38.296862 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:38.296862 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:38.328756 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-11bcc378-f0b3-4bf4-b347-37748ed54df1 tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/a599c1ec-178c-4154-92cf-c60123ecd63b" status: 200 len: 285 microversion: 2.1 time: 0.036436 Jul 13 02:30:38.329324 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 319/634] 10.222.0.32 () {58 vars in 1251 bytes} [Tue Jul 13 02:30:38 2021] GET /compute/v2.1/os-snapshots/a599c1ec-178c-4154-92cf-c60123ecd63b => generated 285 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 02:30:38.484351 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-1eba3aa2-b273-43ff-a40d-891eecb76944 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:38.487284 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:38.487284 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:38.494878 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-1eba3aa2-b273-43ff-a40d-891eecb76944 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1520 microversion: 2.1 time: 0.220738 Jul 13 02:30:38.495446 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 316/635] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:38 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:30:38.996086 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-6bfa9c4a-84f3-4342-9f3b-42592b2a6962 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:38.996696 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-6bfa9c4a-84f3-4342-9f3b-42592b2a6962 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:39.002820 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6bfa9c4a-84f3-4342-9f3b-42592b2a6962 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:39.003401 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6bfa9c4a-84f3-4342-9f3b-42592b2a6962 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:39.004031 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6bfa9c4a-84f3-4342-9f3b-42592b2a6962 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:39.004466 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6bfa9c4a-84f3-4342-9f3b-42592b2a6962 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:39.008087 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:39.008087 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:39.177967 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-6bfa9c4a-84f3-4342-9f3b-42592b2a6962 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:39.180551 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:39.180551 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:39.187321 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-6bfa9c4a-84f3-4342-9f3b-42592b2a6962 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1678 microversion: 2.1 time: 0.194960 Jul 13 02:30:39.187883 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 320/636] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:38 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1678 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:39.340078 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-d880f930-8bf5-4c70-b0c5-3ed86799f6cd tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] Calling method '.version_select at 0x7f43126af700>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:39.365090 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.wsgi [None req-d880f930-8bf5-4c70-b0c5-3ed86799f6cd tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] HTTP exception thrown: Snapshot a599c1ec-178c-4154-92cf-c60123ecd63b could not be found. Jul 13 02:30:39.365806 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-d880f930-8bf5-4c70-b0c5-3ed86799f6cd tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] Returning 404 to user: Snapshot a599c1ec-178c-4154-92cf-c60123ecd63b could not be found. {{(pid=107262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:30:39.366725 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-d880f930-8bf5-4c70-b0c5-3ed86799f6cd tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] 10.222.0.32 "GET /compute/v2.1/os-snapshots/a599c1ec-178c-4154-92cf-c60123ecd63b" status: 404 len: 111 microversion: 2.1 time: 0.030264 Jul 13 02:30:39.367262 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 317/637] 10.222.0.32 () {58 vars in 1251 bytes} [Tue Jul 13 02:30:39 2021] GET /compute/v2.1/os-snapshots/a599c1ec-178c-4154-92cf-c60123ecd63b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 02:30:39.375094 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-f5f5a6b5-fa3c-455e-9a10-f979d79e5111 tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] Calling method '.version_select at 0x7f4312c19ca0>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:39.431864 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-f5f5a6b5-fa3c-455e-9a10-f979d79e5111 tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/fb5d7cdd-d28e-4980-8717-000ed531980b" status: 202 len: 0 microversion: 2.1 time: 0.060309 Jul 13 02:30:39.432468 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 321/638] 10.222.0.32 () {58 vars in 1248 bytes} [Tue Jul 13 02:30:39 2021] DELETE /compute/v2.1/os-volumes/fb5d7cdd-d28e-4980-8717-000ed531980b => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:30:39.440278 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-c7b3d7c2-dc37-41cd-bdf2-c1371d2501cb tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] Calling method '.version_select at 0x7f43126ff4c0>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:39.491649 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-c7b3d7c2-dc37-41cd-bdf2-c1371d2501cb tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/fb5d7cdd-d28e-4980-8717-000ed531980b" status: 200 len: 343 microversion: 2.1 time: 0.054867 Jul 13 02:30:39.492224 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 318/639] 10.222.0.32 () {58 vars in 1245 bytes} [Tue Jul 13 02:30:39 2021] GET /compute/v2.1/os-volumes/fb5d7cdd-d28e-4980-8717-000ed531980b => generated 343 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:30:39.512046 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-9e6c661c-3122-4d7a-ba4d-8f47cbc218b8 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:39.512701 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-9e6c661c-3122-4d7a-ba4d-8f47cbc218b8 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:39.519227 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-9e6c661c-3122-4d7a-ba4d-8f47cbc218b8 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:39.519682 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-9e6c661c-3122-4d7a-ba4d-8f47cbc218b8 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:39.520449 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-9e6c661c-3122-4d7a-ba4d-8f47cbc218b8 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:39.520922 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-9e6c661c-3122-4d7a-ba4d-8f47cbc218b8 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:39.523887 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:39.523887 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:39.698654 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-9e6c661c-3122-4d7a-ba4d-8f47cbc218b8 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:39.701214 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:39.701214 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:39.708025 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-9e6c661c-3122-4d7a-ba4d-8f47cbc218b8 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1520 microversion: 2.1 time: 0.199653 Jul 13 02:30:39.708618 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 322/640] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:39 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:40.204842 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-4d2947ac-108a-42d1-84e2-97d70a9519f3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:40.205458 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-4d2947ac-108a-42d1-84e2-97d70a9519f3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:40.211986 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-4d2947ac-108a-42d1-84e2-97d70a9519f3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:40.212447 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-4d2947ac-108a-42d1-84e2-97d70a9519f3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:40.213206 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-4d2947ac-108a-42d1-84e2-97d70a9519f3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:40.213635 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-4d2947ac-108a-42d1-84e2-97d70a9519f3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:40.216489 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:40.216489 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:40.387364 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-4d2947ac-108a-42d1-84e2-97d70a9519f3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:40.390244 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:40.390244 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:40.397770 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-4d2947ac-108a-42d1-84e2-97d70a9519f3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1678 microversion: 2.1 time: 0.196796 Jul 13 02:30:40.398362 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 319/641] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:40 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1678 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:40.503934 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-ade283a8-ebed-4d58-a215-b4a08e74d461 tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] Calling method '.version_select at 0x7f4312c19c10>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:40.557602 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-ade283a8-ebed-4d58-a215-b4a08e74d461 tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/fb5d7cdd-d28e-4980-8717-000ed531980b" status: 200 len: 343 microversion: 2.1 time: 0.057244 Jul 13 02:30:40.558201 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 323/642] 10.222.0.32 () {58 vars in 1245 bytes} [Tue Jul 13 02:30:40 2021] GET /compute/v2.1/os-volumes/fb5d7cdd-d28e-4980-8717-000ed531980b => generated 343 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:30:40.724561 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-adfde40c-0ed9-4ef5-8fef-c690fc93fd85 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:40.725176 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-adfde40c-0ed9-4ef5-8fef-c690fc93fd85 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:40.730931 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-adfde40c-0ed9-4ef5-8fef-c690fc93fd85 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:40.731380 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-adfde40c-0ed9-4ef5-8fef-c690fc93fd85 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:40.732143 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-adfde40c-0ed9-4ef5-8fef-c690fc93fd85 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:40.732578 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-adfde40c-0ed9-4ef5-8fef-c690fc93fd85 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:40.735438 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:40.735438 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:40.907889 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-adfde40c-0ed9-4ef5-8fef-c690fc93fd85 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:40.910455 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:40.910455 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:40.917256 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-adfde40c-0ed9-4ef5-8fef-c690fc93fd85 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1520 microversion: 2.1 time: 0.196461 Jul 13 02:30:40.917819 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 320/643] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:40 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1520 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:41.414993 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-cdb19172-ce3c-46ac-983e-79440bda34de tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:41.415633 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-cdb19172-ce3c-46ac-983e-79440bda34de tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:41.421442 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-cdb19172-ce3c-46ac-983e-79440bda34de tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:41.421891 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-cdb19172-ce3c-46ac-983e-79440bda34de tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:41.422700 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-cdb19172-ce3c-46ac-983e-79440bda34de tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:41.423136 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-cdb19172-ce3c-46ac-983e-79440bda34de tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:41.425960 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:41.425960 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:41.570421 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-d31f9538-13da-43c1-956f-d362f5d1323e tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] Calling method '.version_select at 0x7f43126ff8b0>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:41.599856 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-cdb19172-ce3c-46ac-983e-79440bda34de tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:41.602447 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:41.602447 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:41.609203 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-cdb19172-ce3c-46ac-983e-79440bda34de tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1678 microversion: 2.1 time: 0.198396 Jul 13 02:30:41.609848 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 324/644] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:41 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1678 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:41.621327 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-d31f9538-13da-43c1-956f-d362f5d1323e tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/fb5d7cdd-d28e-4980-8717-000ed531980b" status: 200 len: 343 microversion: 2.1 time: 0.054688 Jul 13 02:30:41.621897 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 321/645] 10.222.0.32 () {58 vars in 1245 bytes} [Tue Jul 13 02:30:41 2021] GET /compute/v2.1/os-volumes/fb5d7cdd-d28e-4980-8717-000ed531980b => generated 343 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 02:30:41.935349 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-ac563f53-e3ea-4d46-b3b5-42cb8d8dfeb1 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:41.935972 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-ac563f53-e3ea-4d46-b3b5-42cb8d8dfeb1 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:41.942214 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ac563f53-e3ea-4d46-b3b5-42cb8d8dfeb1 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:41.943201 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ac563f53-e3ea-4d46-b3b5-42cb8d8dfeb1 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:41.944040 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ac563f53-e3ea-4d46-b3b5-42cb8d8dfeb1 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:41.944469 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ac563f53-e3ea-4d46-b3b5-42cb8d8dfeb1 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:41.947299 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:41.947299 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:42.121816 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-ac563f53-e3ea-4d46-b3b5-42cb8d8dfeb1 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:42.124399 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:42.124399 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:42.131755 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-ac563f53-e3ea-4d46-b3b5-42cb8d8dfeb1 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1520 microversion: 2.1 time: 0.200516 Jul 13 02:30:42.132323 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 325/646] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:41 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:42.625829 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-c449c4ad-cd22-442b-aadd-ea8aa91c7368 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:42.626470 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-c449c4ad-cd22-442b-aadd-ea8aa91c7368 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:42.633272 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c449c4ad-cd22-442b-aadd-ea8aa91c7368 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:42.633717 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c449c4ad-cd22-442b-aadd-ea8aa91c7368 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:42.633941 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-ecc70b9f-6635-4de9-bf68-61f764e51708 tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] Calling method '.version_select at 0x7f43141f7ee0>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:42.634513 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c449c4ad-cd22-442b-aadd-ea8aa91c7368 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:42.634947 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c449c4ad-cd22-442b-aadd-ea8aa91c7368 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:42.638073 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:42.638073 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:42.662321 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.wsgi [None req-ecc70b9f-6635-4de9-bf68-61f764e51708 tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] HTTP exception thrown: Volume fb5d7cdd-d28e-4980-8717-000ed531980b could not be found. Jul 13 02:30:42.662989 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-ecc70b9f-6635-4de9-bf68-61f764e51708 tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] Returning 404 to user: Volume fb5d7cdd-d28e-4980-8717-000ed531980b could not be found. {{(pid=107263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:30:42.663760 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-ecc70b9f-6635-4de9-bf68-61f764e51708 tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/fb5d7cdd-d28e-4980-8717-000ed531980b" status: 404 len: 109 microversion: 2.1 time: 0.034069 Jul 13 02:30:42.664358 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 326/647] 10.222.0.32 () {58 vars in 1245 bytes} [Tue Jul 13 02:30:42 2021] GET /compute/v2.1/os-volumes/fb5d7cdd-d28e-4980-8717-000ed531980b => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 02:30:42.677522 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-a57d25a2-0e9a-4c49-8649-caeab6c4f4e4 tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] Calling method '.version_select at 0x7f4312ea3e50>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:42.706292 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.wsgi [None req-a57d25a2-0e9a-4c49-8649-caeab6c4f4e4 tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] HTTP exception thrown: Volume fb5d7cdd-d28e-4980-8717-000ed531980b could not be found. Jul 13 02:30:42.706898 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-a57d25a2-0e9a-4c49-8649-caeab6c4f4e4 tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] Returning 404 to user: Volume fb5d7cdd-d28e-4980-8717-000ed531980b could not be found. {{(pid=107263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:30:42.707735 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-a57d25a2-0e9a-4c49-8649-caeab6c4f4e4 tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/fb5d7cdd-d28e-4980-8717-000ed531980b" status: 404 len: 109 microversion: 2.1 time: 0.033788 Jul 13 02:30:42.708883 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 327/648] 10.222.0.32 () {58 vars in 1248 bytes} [Tue Jul 13 02:30:42 2021] DELETE /compute/v2.1/os-volumes/fb5d7cdd-d28e-4980-8717-000ed531980b => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 13 02:30:42.716431 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-20672dc9-a44a-42c7-8ae2-d741744fdcc5 tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] Calling method '.version_select at 0x7f43138bb790>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:42.743181 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.wsgi [None req-20672dc9-a44a-42c7-8ae2-d741744fdcc5 tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] HTTP exception thrown: Volume fb5d7cdd-d28e-4980-8717-000ed531980b could not be found. Jul 13 02:30:42.743911 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-20672dc9-a44a-42c7-8ae2-d741744fdcc5 tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] Returning 404 to user: Volume fb5d7cdd-d28e-4980-8717-000ed531980b could not be found. {{(pid=107263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:30:42.744778 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-20672dc9-a44a-42c7-8ae2-d741744fdcc5 tempest-VolumesSnapshotsTestJSON-44775073 tempest-VolumesSnapshotsTestJSON-44775073-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/fb5d7cdd-d28e-4980-8717-000ed531980b" status: 404 len: 109 microversion: 2.1 time: 0.031760 Jul 13 02:30:42.745319 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 328/649] 10.222.0.32 () {58 vars in 1245 bytes} [Tue Jul 13 02:30:42 2021] GET /compute/v2.1/os-volumes/fb5d7cdd-d28e-4980-8717-000ed531980b => generated 109 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 13 02:30:42.813655 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-c449c4ad-cd22-442b-aadd-ea8aa91c7368 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:42.816684 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:42.816684 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:42.824238 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-c449c4ad-cd22-442b-aadd-ea8aa91c7368 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1655 microversion: 2.1 time: 0.202001 Jul 13 02:30:42.824808 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 322/650] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:42 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1655 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:42.841884 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-ab5fd7b1-9ae6-44d9-9231-c5b2a5e7a248 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:30:42.847721 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ab5fd7b1-9ae6-44d9-9231-c5b2a5e7a248 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:42.848562 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ab5fd7b1-9ae6-44d9-9231-c5b2a5e7a248 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:42.851268 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:42.851268 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:42.913645 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-ab5fd7b1-9ae6-44d9-9231-c5b2a5e7a248 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Going to try to start instance {{(pid=107263) start /opt/stack/nova/nova/compute/api.py:2605}} Jul 13 02:30:42.917691 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:42.917691 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:42.974197 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/update_match.py:472: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:42.974197 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = query.session.execute(update_stmt) Jul 13 02:30:42.996101 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-ab5fd7b1-9ae6-44d9-9231-c5b2a5e7a248 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action" status: 202 len: 0 microversion: 2.1 time: 0.158337 Jul 13 02:30:42.997055 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 329/651] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:30:42 2021] POST /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:30:43.004877 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-e1f06a86-2f40-46d6-8ae6-fa5bdec87b31 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:43.006823 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-e1f06a86-2f40-46d6-8ae6-fa5bdec87b31 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:43.016632 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e1f06a86-2f40-46d6-8ae6-fa5bdec87b31 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:43.017269 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e1f06a86-2f40-46d6-8ae6-fa5bdec87b31 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:43.018248 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e1f06a86-2f40-46d6-8ae6-fa5bdec87b31 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:43.018689 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e1f06a86-2f40-46d6-8ae6-fa5bdec87b31 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:43.022041 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:43.022041 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:43.150642 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-0e4ea389-f3d7-44fe-990d-2a5b9c1efa51 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:43.151500 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-0e4ea389-f3d7-44fe-990d-2a5b9c1efa51 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:43.158654 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0e4ea389-f3d7-44fe-990d-2a5b9c1efa51 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:43.162406 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0e4ea389-f3d7-44fe-990d-2a5b9c1efa51 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:43.163453 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0e4ea389-f3d7-44fe-990d-2a5b9c1efa51 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:43.164012 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0e4ea389-f3d7-44fe-990d-2a5b9c1efa51 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:43.167600 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:43.167600 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:43.205983 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-e1f06a86-2f40-46d6-8ae6-fa5bdec87b31 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:43.208877 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:43.208877 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:43.216655 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-e1f06a86-2f40-46d6-8ae6-fa5bdec87b31 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1664 microversion: 2.1 time: 0.215534 Jul 13 02:30:43.217238 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 323/652] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:42 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1664 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:43.425594 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-0e4ea389-f3d7-44fe-990d-2a5b9c1efa51 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:43.428935 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:43.428935 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:43.436106 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-0e4ea389-f3d7-44fe-990d-2a5b9c1efa51 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1520 microversion: 2.1 time: 0.291008 Jul 13 02:30:43.436676 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 330/653] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:43 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1520 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:30:44.235222 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-4ecc4d00-20f8-4ba6-ab72-ac31f7632216 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:44.235836 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-4ecc4d00-20f8-4ba6-ab72-ac31f7632216 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:44.244566 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-4ecc4d00-20f8-4ba6-ab72-ac31f7632216 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:44.245057 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-4ecc4d00-20f8-4ba6-ab72-ac31f7632216 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:44.245834 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-4ecc4d00-20f8-4ba6-ab72-ac31f7632216 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:44.246294 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-4ecc4d00-20f8-4ba6-ab72-ac31f7632216 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:44.249975 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:44.249975 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:44.429065 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-4ecc4d00-20f8-4ba6-ab72-ac31f7632216 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:44.431735 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:44.431735 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:44.438997 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-4ecc4d00-20f8-4ba6-ab72-ac31f7632216 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1664 microversion: 2.1 time: 0.207426 Jul 13 02:30:44.439395 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 324/654] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:44 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1664 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:44.452435 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-0c0df151-1284-4463-b97d-7274aa0f88ab tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:44.453199 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-0c0df151-1284-4463-b97d-7274aa0f88ab tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:44.459256 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0c0df151-1284-4463-b97d-7274aa0f88ab tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:44.459782 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0c0df151-1284-4463-b97d-7274aa0f88ab tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:44.460643 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0c0df151-1284-4463-b97d-7274aa0f88ab tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:44.461289 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0c0df151-1284-4463-b97d-7274aa0f88ab tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:44.464389 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:44.464389 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:44.657329 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-0c0df151-1284-4463-b97d-7274aa0f88ab tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:44.659889 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:44.659889 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:44.667784 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-0c0df151-1284-4463-b97d-7274aa0f88ab tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1520 microversion: 2.1 time: 0.218945 Jul 13 02:30:44.668344 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 331/655] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:44 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:45.455788 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-2cda0c6a-94e6-4a1a-9b22-874450eebd50 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:45.456404 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-2cda0c6a-94e6-4a1a-9b22-874450eebd50 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:45.462360 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2cda0c6a-94e6-4a1a-9b22-874450eebd50 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:45.462803 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2cda0c6a-94e6-4a1a-9b22-874450eebd50 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:45.463585 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2cda0c6a-94e6-4a1a-9b22-874450eebd50 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:45.464038 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2cda0c6a-94e6-4a1a-9b22-874450eebd50 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:45.466846 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:45.466846 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:45.673798 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-2cda0c6a-94e6-4a1a-9b22-874450eebd50 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:45.676383 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:45.676383 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:45.683897 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-2cda0c6a-94e6-4a1a-9b22-874450eebd50 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1664 microversion: 2.1 time: 0.231658 Jul 13 02:30:45.684475 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 325/656] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:45 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1664 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:45.684664 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-e84316ee-9395-4e84-8698-6fbccba12f7f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:45.685298 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-e84316ee-9395-4e84-8698-6fbccba12f7f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:45.691030 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e84316ee-9395-4e84-8698-6fbccba12f7f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:45.691472 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e84316ee-9395-4e84-8698-6fbccba12f7f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:45.692233 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e84316ee-9395-4e84-8698-6fbccba12f7f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:45.693304 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e84316ee-9395-4e84-8698-6fbccba12f7f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:45.696143 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:45.696143 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:45.963993 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-e84316ee-9395-4e84-8698-6fbccba12f7f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:45.967274 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:45.967274 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:45.975562 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-e84316ee-9395-4e84-8698-6fbccba12f7f tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1520 microversion: 2.1 time: 0.294711 Jul 13 02:30:45.976227 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 332/657] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:45 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1520 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:30:46.702001 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-d953d6fb-4a0e-4174-97c3-4ff3b46a05fa tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:46.702728 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-d953d6fb-4a0e-4174-97c3-4ff3b46a05fa tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:46.708630 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d953d6fb-4a0e-4174-97c3-4ff3b46a05fa tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:46.709150 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d953d6fb-4a0e-4174-97c3-4ff3b46a05fa tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:46.709983 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d953d6fb-4a0e-4174-97c3-4ff3b46a05fa tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:46.711430 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d953d6fb-4a0e-4174-97c3-4ff3b46a05fa tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:46.714564 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:46.714564 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:46.887434 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-d953d6fb-4a0e-4174-97c3-4ff3b46a05fa tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:46.890226 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:46.890226 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:46.897965 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-d953d6fb-4a0e-4174-97c3-4ff3b46a05fa tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1664 microversion: 2.1 time: 0.200015 Jul 13 02:30:46.898557 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 326/658] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:46 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1664 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:46.992694 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-a45e9f8e-6471-4582-b0fc-40c04a783fa7 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:46.993304 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-a45e9f8e-6471-4582-b0fc-40c04a783fa7 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:46.999045 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a45e9f8e-6471-4582-b0fc-40c04a783fa7 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:46.999542 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a45e9f8e-6471-4582-b0fc-40c04a783fa7 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:47.000310 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a45e9f8e-6471-4582-b0fc-40c04a783fa7 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:47.000741 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a45e9f8e-6471-4582-b0fc-40c04a783fa7 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:47.003681 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:47.003681 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:47.197459 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-a45e9f8e-6471-4582-b0fc-40c04a783fa7 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:47.200145 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:47.200145 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:47.207794 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-a45e9f8e-6471-4582-b0fc-40c04a783fa7 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1520 microversion: 2.1 time: 0.219151 Jul 13 02:30:47.208356 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 333/659] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:46 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:47.689716 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-05e8f456-9608-4233-b989-4eb6670b994a req-4883d9e5-1e64-4cc4-bc69-c63c0d86b5c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "163ad440-5d5c-420d-ab44-52f27c5e22dc", "name": "network-vif-deleted", "tag": "b303b0dd-0f82-4db9-98d2-7bd04096a59a"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:30:47.691552 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:30:47.691552 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:30:47.700797 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-05e8f456-9608-4233-b989-4eb6670b994a req-4883d9e5-1e64-4cc4-bc69-c63c0d86b5c3 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:47.701226 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-05e8f456-9608-4233-b989-4eb6670b994a req-4883d9e5-1e64-4cc4-bc69-c63c0d86b5c3 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:47.713219 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-05e8f456-9608-4233-b989-4eb6670b994a req-4883d9e5-1e64-4cc4-bc69-c63c0d86b5c3 service nova] Creating event network-vif-deleted:b303b0dd-0f82-4db9-98d2-7bd04096a59a for instance 163ad440-5d5c-420d-ab44-52f27c5e22dc on hv-cinder-78102 Jul 13 02:30:47.718720 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-05e8f456-9608-4233-b989-4eb6670b994a req-4883d9e5-1e64-4cc4-bc69-c63c0d86b5c3 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032109 Jul 13 02:30:47.719465 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 327/660] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:30:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:30:47.915760 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-2df9de3d-633f-47de-85ba-107bd29f0d58 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:47.916294 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-2df9de3d-633f-47de-85ba-107bd29f0d58 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:47.922214 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2df9de3d-633f-47de-85ba-107bd29f0d58 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:47.922734 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2df9de3d-633f-47de-85ba-107bd29f0d58 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:47.923553 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2df9de3d-633f-47de-85ba-107bd29f0d58 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:47.924010 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2df9de3d-633f-47de-85ba-107bd29f0d58 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:47.926839 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:47.926839 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:48.106143 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-2df9de3d-633f-47de-85ba-107bd29f0d58 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:48.108781 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:48.108781 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:48.115783 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-2df9de3d-633f-47de-85ba-107bd29f0d58 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1668 microversion: 2.1 time: 0.204478 Jul 13 02:30:48.116351 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 334/661] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:47 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1668 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:48.224990 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-ec859365-f01c-408a-af97-345985981990 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:48.225716 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-ec859365-f01c-408a-af97-345985981990 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:48.231729 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ec859365-f01c-408a-af97-345985981990 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:48.232180 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ec859365-f01c-408a-af97-345985981990 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:48.232957 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ec859365-f01c-408a-af97-345985981990 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:48.233393 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ec859365-f01c-408a-af97-345985981990 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:48.236282 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:48.236282 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:48.306271 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ec859365-f01c-408a-af97-345985981990 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:48.306713 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ec859365-f01c-408a-af97-345985981990 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:48.307158 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.objects.instance [None req-ec859365-f01c-408a-af97-345985981990 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lazy-loading 'fault' on Instance uuid 163ad440-5d5c-420d-ab44-52f27c5e22dc {{(pid=107262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 13 02:30:48.309142 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:4002: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:48.309142 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: for row in query: Jul 13 02:30:48.350619 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-ec859365-f01c-408a-af97-345985981990 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b72418c3974756b604d0acb2c8188b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc0ee8f5f4bc44599b259e826174d9ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:48.353118 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:48.353118 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:48.359775 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-ec859365-f01c-408a-af97-345985981990 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 200 len: 1311 microversion: 2.1 time: 0.138998 Jul 13 02:30:48.360344 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 328/662] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:48 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 1311 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:49.378216 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-2c67f773-1faa-4a76-90da-fb7b75db1064 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:49.378862 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-2c67f773-1faa-4a76-90da-fb7b75db1064 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] [instance: 163ad440-5d5c-420d-ab44-52f27c5e22dc] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:49.386629 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2c67f773-1faa-4a76-90da-fb7b75db1064 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:49.387248 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2c67f773-1faa-4a76-90da-fb7b75db1064 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:49.388286 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2c67f773-1faa-4a76-90da-fb7b75db1064 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:49.388741 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2c67f773-1faa-4a76-90da-fb7b75db1064 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:49.391744 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:49.391744 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:49.441444 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.wsgi [None req-2c67f773-1faa-4a76-90da-fb7b75db1064 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] HTTP exception thrown: Instance 163ad440-5d5c-420d-ab44-52f27c5e22dc could not be found. Jul 13 02:30:49.442060 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-2c67f773-1faa-4a76-90da-fb7b75db1064 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] Returning 404 to user: Instance 163ad440-5d5c-420d-ab44-52f27c5e22dc could not be found. {{(pid=107263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:30:49.443454 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-2c67f773-1faa-4a76-90da-fb7b75db1064 tempest-ServerRescueNegativeTestJSON-1576831732 tempest-ServerRescueNegativeTestJSON-1576831732-project] 10.222.0.32 "GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc" status: 404 len: 111 microversion: 2.1 time: 0.069361 Jul 13 02:30:49.444011 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 335/663] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:49 2021] GET /compute/v2.1/servers/163ad440-5d5c-420d-ab44-52f27c5e22dc => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 02:30:49.937796 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-bfcb6f3e-ac24-4145-8724-3525354c418d tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:49.938351 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-bfcb6f3e-ac24-4145-8724-3525354c418d tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 325ba981-747f-4908-a6d4-529a36297483] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:49.944874 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-bfcb6f3e-ac24-4145-8724-3525354c418d tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:49.945325 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-bfcb6f3e-ac24-4145-8724-3525354c418d tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:49.946122 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-bfcb6f3e-ac24-4145-8724-3525354c418d tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:49.946560 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-bfcb6f3e-ac24-4145-8724-3525354c418d tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:49.949318 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:49.949318 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:50.073575 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3031: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:50.073575 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context, Jul 13 02:30:50.080198 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.objects.instance [None req-bfcb6f3e-ac24-4145-8724-3525354c418d tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lazy-loading 'services' on Instance uuid 325ba981-747f-4908-a6d4-529a36297483 {{(pid=107262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 13 02:30:50.156850 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-bfcb6f3e-ac24-4145-8724-3525354c418d tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "DELETE /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483/os-volume_attachments/9052ce2e-0de2-46e6-a2ab-36c261438353" status: 202 len: 0 microversion: 2.1 time: 0.222249 Jul 13 02:30:50.157457 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 329/664] 10.222.0.32 () {58 vars in 1416 bytes} [Tue Jul 13 02:30:49 2021] DELETE /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483/os-volume_attachments/9052ce2e-0de2-46e6-a2ab-36c261438353 => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 13 02:30:51.322680 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-65290d8e-94cb-4e16-a421-4b0cd90f414a tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:51.323816 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-65290d8e-94cb-4e16-a421-4b0cd90f414a tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 325ba981-747f-4908-a6d4-529a36297483] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:51.330131 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-65290d8e-94cb-4e16-a421-4b0cd90f414a tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:51.330762 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-65290d8e-94cb-4e16-a421-4b0cd90f414a tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:51.331700 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-65290d8e-94cb-4e16-a421-4b0cd90f414a tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:51.332298 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-65290d8e-94cb-4e16-a421-4b0cd90f414a tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:51.347317 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:51.347317 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:51.436104 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-65290d8e-94cb-4e16-a421-4b0cd90f414a tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 325ba981-747f-4908-a6d4-529a36297483] Going to try to terminate instance {{(pid=107263) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 13 02:30:51.438505 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3008: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:51.438505 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).\ Jul 13 02:30:51.452102 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:51.452102 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:51.516330 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/update_match.py:472: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:51.516330 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = query.session.execute(update_stmt) Jul 13 02:30:51.532486 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:530: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:51.532486 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = model_query(context, models.Service, read_deleted="no").\ Jul 13 02:30:51.581841 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-65290d8e-94cb-4e16-a421-4b0cd90f414a tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "DELETE /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483" status: 204 len: 0 microversion: 2.1 time: 0.260289 Jul 13 02:30:51.583068 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 336/665] 10.222.0.32 () {58 vars in 1239 bytes} [Tue Jul 13 02:30:51 2021] DELETE /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 13 02:30:51.591965 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-58bb86d4-42b2-4638-bafa-697391156591 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:51.592668 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-58bb86d4-42b2-4638-bafa-697391156591 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 325ba981-747f-4908-a6d4-529a36297483] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:51.601021 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-58bb86d4-42b2-4638-bafa-697391156591 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:51.601633 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-58bb86d4-42b2-4638-bafa-697391156591 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:51.602666 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-58bb86d4-42b2-4638-bafa-697391156591 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:51.603261 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-58bb86d4-42b2-4638-bafa-697391156591 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:51.609282 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:51.609282 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:51.801866 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-58bb86d4-42b2-4638-bafa-697391156591 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21025e2c8aa9423dbd05da95f237b481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2c1d46685432e8656123be9d86664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:51.804857 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:51.804857 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:51.812208 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-58bb86d4-42b2-4638-bafa-697391156591 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "GET /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483" status: 200 len: 1514 microversion: 2.1 time: 0.224188 Jul 13 02:30:51.821910 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 330/666] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:51 2021] GET /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483 => generated 1514 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:52.830497 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-d04d5ab7-481e-4652-89fa-aacd67eb387c tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:52.832071 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-d04d5ab7-481e-4652-89fa-aacd67eb387c tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 325ba981-747f-4908-a6d4-529a36297483] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:52.839812 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d04d5ab7-481e-4652-89fa-aacd67eb387c tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:52.840276 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d04d5ab7-481e-4652-89fa-aacd67eb387c tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:52.841084 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d04d5ab7-481e-4652-89fa-aacd67eb387c tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:52.841548 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d04d5ab7-481e-4652-89fa-aacd67eb387c tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:52.844826 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:52.844826 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:53.107172 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-d04d5ab7-481e-4652-89fa-aacd67eb387c tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21025e2c8aa9423dbd05da95f237b481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2c1d46685432e8656123be9d86664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:53.109838 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:53.109838 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:53.116850 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-d04d5ab7-481e-4652-89fa-aacd67eb387c tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "GET /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483" status: 200 len: 1514 microversion: 2.1 time: 0.291286 Jul 13 02:30:53.117743 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 337/667] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:52 2021] GET /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483 => generated 1514 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:30:54.093936 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-589ed759-ac80-4763-80d3-2e11b837b24f req-872f3bcd-363b-4be4-bcb8-591527444f49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "325ba981-747f-4908-a6d4-529a36297483", "name": "network-vif-deleted", "tag": "e36bc09f-287f-4d23-8b1e-388f63fb032f"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:30:54.095489 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:30:54.095489 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:30:54.109030 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-589ed759-ac80-4763-80d3-2e11b837b24f req-872f3bcd-363b-4be4-bcb8-591527444f49 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:54.109588 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-589ed759-ac80-4763-80d3-2e11b837b24f req-872f3bcd-363b-4be4-bcb8-591527444f49 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:54.123183 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-589ed759-ac80-4763-80d3-2e11b837b24f req-872f3bcd-363b-4be4-bcb8-591527444f49 service nova] Creating event network-vif-deleted:e36bc09f-287f-4d23-8b1e-388f63fb032f for instance 325ba981-747f-4908-a6d4-529a36297483 on hv-cinder-78102 Jul 13 02:30:54.128634 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-589ed759-ac80-4763-80d3-2e11b837b24f req-872f3bcd-363b-4be4-bcb8-591527444f49 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038130 Jul 13 02:30:54.129594 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 331/668] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:30:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:30:54.137276 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-0d1e36b9-d57b-478a-856f-4684643e02a8 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:54.138161 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-0d1e36b9-d57b-478a-856f-4684643e02a8 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 325ba981-747f-4908-a6d4-529a36297483] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:54.144461 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0d1e36b9-d57b-478a-856f-4684643e02a8 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:54.145105 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0d1e36b9-d57b-478a-856f-4684643e02a8 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:54.146543 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0d1e36b9-d57b-478a-856f-4684643e02a8 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:54.146981 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0d1e36b9-d57b-478a-856f-4684643e02a8 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:54.150103 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:54.150103 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:54.275080 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-0d1e36b9-d57b-478a-856f-4684643e02a8 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '21025e2c8aa9423dbd05da95f237b481', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eaa2c1d46685432e8656123be9d86664', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:30:54.277785 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:54.277785 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:30:54.285364 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-0d1e36b9-d57b-478a-856f-4684643e02a8 tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "GET /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483" status: 200 len: 1303 microversion: 2.1 time: 0.151709 Jul 13 02:30:54.287903 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 338/669] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:54 2021] GET /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483 => generated 1303 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:30:55.303258 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-ed3de9ef-c069-4c37-ae61-0e8e254c920f tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:30:55.303934 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-ed3de9ef-c069-4c37-ae61-0e8e254c920f tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] [instance: 325ba981-747f-4908-a6d4-529a36297483] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:30:55.310126 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ed3de9ef-c069-4c37-ae61-0e8e254c920f tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:55.310573 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ed3de9ef-c069-4c37-ae61-0e8e254c920f tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:55.311341 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ed3de9ef-c069-4c37-ae61-0e8e254c920f tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:30:55.311773 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ed3de9ef-c069-4c37-ae61-0e8e254c920f tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:30:55.314713 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:30:55.314713 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:30:55.363393 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.wsgi [None req-ed3de9ef-c069-4c37-ae61-0e8e254c920f tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] HTTP exception thrown: Instance 325ba981-747f-4908-a6d4-529a36297483 could not be found. Jul 13 02:30:55.363993 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-ed3de9ef-c069-4c37-ae61-0e8e254c920f tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] Returning 404 to user: Instance 325ba981-747f-4908-a6d4-529a36297483 could not be found. {{(pid=107262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:30:55.364955 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-ed3de9ef-c069-4c37-ae61-0e8e254c920f tempest-VolumesSnapshotTestJSON-249376050 tempest-VolumesSnapshotTestJSON-249376050-project] 10.222.0.32 "GET /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483" status: 404 len: 111 microversion: 2.1 time: 0.066084 Jul 13 02:30:55.365508 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 332/670] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:30:55 2021] GET /compute/v2.1/servers/325ba981-747f-4908-a6d4-529a36297483 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 02:31:08.398299 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-63cc44f0-4d01-4f3f-9104-e1e4da30d2d7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:08.398916 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-63cc44f0-4d01-4f3f-9104-e1e4da30d2d7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:08.405598 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-63cc44f0-4d01-4f3f-9104-e1e4da30d2d7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:08.406288 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-63cc44f0-4d01-4f3f-9104-e1e4da30d2d7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:08.407416 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-63cc44f0-4d01-4f3f-9104-e1e4da30d2d7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:08.407856 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-63cc44f0-4d01-4f3f-9104-e1e4da30d2d7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:08.411064 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:08.411064 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:08.479837 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3031: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:08.479837 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context, Jul 13 02:31:08.486920 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-63cc44f0-4d01-4f3f-9104-e1e4da30d2d7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/os-volume_attachments/016a8612-b5c6-4a9a-aae0-5a7e13557b36" status: 200 len: 194 microversion: 2.20 time: 0.093286 Jul 13 02:31:08.487812 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 339/671] 10.222.0.32 () {60 vars in 1454 bytes} [Tue Jul 13 02:31:08 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/os-volume_attachments/016a8612-b5c6-4a9a-aae0-5a7e13557b36 => generated 194 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:31:08.561118 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-f8325a49-244a-4da2-bcc2-9cf6604cf53b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:08.561792 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-f8325a49-244a-4da2-bcc2-9cf6604cf53b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:08.568071 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f8325a49-244a-4da2-bcc2-9cf6604cf53b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:08.568444 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f8325a49-244a-4da2-bcc2-9cf6604cf53b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:08.569521 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f8325a49-244a-4da2-bcc2-9cf6604cf53b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:08.570160 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f8325a49-244a-4da2-bcc2-9cf6604cf53b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:08.573868 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:08.573868 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:08.702151 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3031: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:08.702151 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context, Jul 13 02:31:08.708261 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.objects.instance [None req-f8325a49-244a-4da2-bcc2-9cf6604cf53b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lazy-loading 'services' on Instance uuid 872b8d83-fdcf-4888-b1d3-64f49541426d {{(pid=107262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 13 02:31:08.780422 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-f8325a49-244a-4da2-bcc2-9cf6604cf53b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "DELETE /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/os-volume_attachments/016a8612-b5c6-4a9a-aae0-5a7e13557b36" status: 202 len: 0 microversion: 2.20 time: 0.222785 Jul 13 02:31:08.781008 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 333/672] 10.222.0.32 () {60 vars in 1457 bytes} [Tue Jul 13 02:31:08 2021] DELETE /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d/os-volume_attachments/016a8612-b5c6-4a9a-aae0-5a7e13557b36 => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 13 02:31:09.929946 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-d7c46efb-e715-4263-b496-eeecf0b00dea tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:09.929946 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-d7c46efb-e715-4263-b496-eeecf0b00dea tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:09.931502 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d7c46efb-e715-4263-b496-eeecf0b00dea tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:09.931948 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d7c46efb-e715-4263-b496-eeecf0b00dea tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:09.932763 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d7c46efb-e715-4263-b496-eeecf0b00dea tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:09.933196 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d7c46efb-e715-4263-b496-eeecf0b00dea tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:09.936527 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:09.936527 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:10.017889 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-d7c46efb-e715-4263-b496-eeecf0b00dea tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Going to try to terminate instance {{(pid=107263) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 13 02:31:10.021177 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3008: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:10.021177 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).\ Jul 13 02:31:10.034828 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:10.034828 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:10.102643 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/update_match.py:472: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:10.102643 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = query.session.execute(update_stmt) Jul 13 02:31:10.121154 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:530: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:10.121154 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = model_query(context, models.Service, read_deleted="no").\ Jul 13 02:31:10.184922 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-d7c46efb-e715-4263-b496-eeecf0b00dea tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "DELETE /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 204 len: 0 microversion: 2.20 time: 0.265656 Jul 13 02:31:10.186307 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 340/673] 10.222.0.32 () {60 vars in 1280 bytes} [Tue Jul 13 02:31:09 2021] DELETE /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 0 bytes in 268 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 13 02:31:10.194965 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-5eff644a-a7b9-4bf3-a156-76ae7a7570bb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:10.196511 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-5eff644a-a7b9-4bf3-a156-76ae7a7570bb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:10.203984 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5eff644a-a7b9-4bf3-a156-76ae7a7570bb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:10.204651 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5eff644a-a7b9-4bf3-a156-76ae7a7570bb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:10.205592 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5eff644a-a7b9-4bf3-a156-76ae7a7570bb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:10.206221 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5eff644a-a7b9-4bf3-a156-76ae7a7570bb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:10.210153 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:10.210153 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:10.400584 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-5eff644a-a7b9-4bf3-a156-76ae7a7570bb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:10.403155 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:10.403155 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:31:10.410726 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-5eff644a-a7b9-4bf3-a156-76ae7a7570bb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:10.413191 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-5eff644a-a7b9-4bf3-a156-76ae7a7570bb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:10.414361 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-5eff644a-a7b9-4bf3-a156-76ae7a7570bb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1725 microversion: 2.20 time: 0.223721 Jul 13 02:31:10.414906 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 334/674] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:31:10 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1725 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:31:11.434801 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-d6d5995f-0a91-4806-9094-8f7301ab49b4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:11.436249 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-d6d5995f-0a91-4806-9094-8f7301ab49b4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:11.442913 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d6d5995f-0a91-4806-9094-8f7301ab49b4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:11.443730 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d6d5995f-0a91-4806-9094-8f7301ab49b4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:11.444660 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d6d5995f-0a91-4806-9094-8f7301ab49b4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:11.445391 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d6d5995f-0a91-4806-9094-8f7301ab49b4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:11.449747 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:11.449747 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:11.639458 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-d6d5995f-0a91-4806-9094-8f7301ab49b4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:11.642265 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:11.642265 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:31:11.650504 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-d6d5995f-0a91-4806-9094-8f7301ab49b4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:11.652238 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-d6d5995f-0a91-4806-9094-8f7301ab49b4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:11.653911 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-d6d5995f-0a91-4806-9094-8f7301ab49b4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1725 microversion: 2.20 time: 0.224008 Jul 13 02:31:11.654571 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 341/675] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:31:11 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1725 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:31:12.676727 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-68892582-14eb-498b-a633-d515dce54e60 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:12.677957 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-68892582-14eb-498b-a633-d515dce54e60 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:12.684553 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-68892582-14eb-498b-a633-d515dce54e60 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:12.685078 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-68892582-14eb-498b-a633-d515dce54e60 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:12.685876 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-68892582-14eb-498b-a633-d515dce54e60 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:12.686329 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-68892582-14eb-498b-a633-d515dce54e60 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:12.689504 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:12.689504 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:12.801214 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-68892582-14eb-498b-a633-d515dce54e60 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:12.805681 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:12.805681 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:31:12.813873 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-68892582-14eb-498b-a633-d515dce54e60 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:12.815987 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-68892582-14eb-498b-a633-d515dce54e60 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:12.817798 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-68892582-14eb-498b-a633-d515dce54e60 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1657 microversion: 2.20 time: 0.144635 Jul 13 02:31:12.818469 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 335/676] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:31:12 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1657 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:31:13.185987 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [req-33df3e16-4fcc-460a-9d5c-45c8b30271c5 req-a3c63063-4b3c-451d-b68d-27f91609f207 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "872b8d83-fdcf-4888-b1d3-64f49541426d", "name": "network-vif-deleted", "tag": "49588aa8-e16a-42d4-9d7e-8c1cf67a6211"}]} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:31:13.187807 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:31:13.187807 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: warnings.warn(msg) Jul 13 02:31:13.197611 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-33df3e16-4fcc-460a-9d5c-45c8b30271c5 req-a3c63063-4b3c-451d-b68d-27f91609f207 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:13.198091 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-33df3e16-4fcc-460a-9d5c-45c8b30271c5 req-a3c63063-4b3c-451d-b68d-27f91609f207 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:13.214579 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.compute.server_external_events [req-33df3e16-4fcc-460a-9d5c-45c8b30271c5 req-a3c63063-4b3c-451d-b68d-27f91609f207 service nova] Creating event network-vif-deleted:49588aa8-e16a-42d4-9d7e-8c1cf67a6211 for instance 872b8d83-fdcf-4888-b1d3-64f49541426d on hv-cinder-78102 Jul 13 02:31:13.220349 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [req-33df3e16-4fcc-460a-9d5c-45c8b30271c5 req-a3c63063-4b3c-451d-b68d-27f91609f207 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039059 Jul 13 02:31:13.221042 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 342/677] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:31:13 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:31:13.836139 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-b5f9d1c2-d462-4019-95aa-3eefa5622fca tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:13.837065 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-b5f9d1c2-d462-4019-95aa-3eefa5622fca tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:13.846998 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b5f9d1c2-d462-4019-95aa-3eefa5622fca tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:13.852107 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b5f9d1c2-d462-4019-95aa-3eefa5622fca tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:13.853993 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b5f9d1c2-d462-4019-95aa-3eefa5622fca tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:13.862482 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b5f9d1c2-d462-4019-95aa-3eefa5622fca tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:13.870061 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:13.870061 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:13.964092 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b5f9d1c2-d462-4019-95aa-3eefa5622fca tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:13.964689 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b5f9d1c2-d462-4019-95aa-3eefa5622fca tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:13.965143 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.objects.instance [None req-b5f9d1c2-d462-4019-95aa-3eefa5622fca tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lazy-loading 'fault' on Instance uuid 872b8d83-fdcf-4888-b1d3-64f49541426d {{(pid=107262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 13 02:31:13.967462 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:4002: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:13.967462 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: for row in query: Jul 13 02:31:14.018115 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-b5f9d1c2-d462-4019-95aa-3eefa5622fca tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:14.021672 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:14.021672 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:31:14.029995 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-b5f9d1c2-d462-4019-95aa-3eefa5622fca tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:14.031879 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-b5f9d1c2-d462-4019-95aa-3eefa5622fca tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:14.033108 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-b5f9d1c2-d462-4019-95aa-3eefa5622fca tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 200 len: 1372 microversion: 2.20 time: 0.200686 Jul 13 02:31:14.033662 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 336/678] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:31:13 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 1372 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:31:15.052053 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-d0f5b4aa-34c8-4984-a708-93d09202cc4a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:15.053816 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-d0f5b4aa-34c8-4984-a708-93d09202cc4a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:15.059823 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d0f5b4aa-34c8-4984-a708-93d09202cc4a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:15.060270 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d0f5b4aa-34c8-4984-a708-93d09202cc4a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:15.061047 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d0f5b4aa-34c8-4984-a708-93d09202cc4a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:15.061482 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d0f5b4aa-34c8-4984-a708-93d09202cc4a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:15.064522 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:15.064522 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:15.113715 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.wsgi [None req-d0f5b4aa-34c8-4984-a708-93d09202cc4a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] HTTP exception thrown: Instance 872b8d83-fdcf-4888-b1d3-64f49541426d could not be found. Jul 13 02:31:15.114627 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-d0f5b4aa-34c8-4984-a708-93d09202cc4a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Returning 404 to user: Instance 872b8d83-fdcf-4888-b1d3-64f49541426d could not be found. {{(pid=107263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:31:15.115463 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-d0f5b4aa-34c8-4984-a708-93d09202cc4a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 404 len: 111 microversion: 2.20 time: 0.067634 Jul 13 02:31:15.116019 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 343/679] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:31:15 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 13 02:31:15.124223 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-bc89b922-7d6f-4f69-aaef-a380ee12b3f9 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '.version_select at 0x7f43126bd9d0>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:15.146311 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-bc89b922-7d6f-4f69-aaef-a380ee12b3f9 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1055037345" status: 204 len: 0 microversion: 2.20 time: 0.025606 Jul 13 02:31:15.146969 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 337/680] 10.222.0.32 () {60 vars in 1262 bytes} [Tue Jul 13 02:31:15 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1055037345 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 13 02:31:15.909902 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-1f33f0d0-b9ec-487f-a7dc-de54dc887dcd tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'create', calling method: .version_select at 0x7f4312f0ea60>, body: {"keypair": {"name": "tempest-keypair-302677435"}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:31:15.923596 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2656: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:15.923596 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return model_query(context, models.KeyPair, read_deleted="no").\ Jul 13 02:31:15.936101 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2708: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:15.936101 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: rows = model_query(context, models.Quota, read_deleted="no").\ Jul 13 02:31:15.939676 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.quota [None req-1f33f0d0-b9ec-487f-a7dc-de54dc887dcd tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Getting quotas for project 63a044a9d95c49ce9281f67e741cf8ad. Resources: {'key_pairs'} {{(pid=107263) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 13 02:31:15.943735 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.quota [None req-1f33f0d0-b9ec-487f-a7dc-de54dc887dcd tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Getting quotas for user a5fff5f367864fbb9a8731f6dfbc4d62 and project 63a044a9d95c49ce9281f67e741cf8ad. Resources: {'key_pairs'} {{(pid=107263) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 13 02:31:15.949044 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2690: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:15.949044 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: user_quotas = model_query(context, models.ProjectUserQuota, Jul 13 02:31:16.153854 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2621: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:16.153854 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = model_query(context, models.KeyPair).\ Jul 13 02:31:16.187885 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.quota [None req-1f33f0d0-b9ec-487f-a7dc-de54dc887dcd tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Getting quotas for project 63a044a9d95c49ce9281f67e741cf8ad. Resources: {'key_pairs'} {{(pid=107263) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 13 02:31:16.191567 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.quota [None req-1f33f0d0-b9ec-487f-a7dc-de54dc887dcd tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Getting quotas for user a5fff5f367864fbb9a8731f6dfbc4d62 and project 63a044a9d95c49ce9281f67e741cf8ad. Resources: {'key_pairs'} {{(pid=107263) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 13 02:31:16.205324 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-1f33f0d0-b9ec-487f-a7dc-de54dc887dcd tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.299334 Jul 13 02:31:16.205925 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 344/681] 10.222.0.32 () {62 vars in 1199 bytes} [Tue Jul 13 02:31:15 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 301 msecs (HTTP/1.1 201) 9 headers in 365 bytes (2 switches on core 0) Jul 13 02:31:17.573721 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-553d4a83-2a68-4a46-bafd-134fe1e4d05e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1681074228", "imageRef": "1a3efd47-3618-4abd-b00b-a9fa9b90b4d4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4baa4fb6-de8b-4124-9674-6f3872d23a0f"}], "security_groups": [{"name": "tempest-securitygroup--1531042067"}], "key_name": "tempest-keypair-302677435", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:31:17.673264 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.network.neutron [None req-553d4a83-2a68-4a46-bafd-134fe1e4d05e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] validate_networks() for [('4baa4fb6-de8b-4124-9674-6f3872d23a0f', None, None, None)] {{(pid=107262) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Jul 13 02:31:18.070717 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-553d4a83-2a68-4a46-bafd-134fe1e4d05e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Flavor limits 0:0:0 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 02:31:18.071234 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-553d4a83-2a68-4a46-bafd-134fe1e4d05e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Image limits 0:0:0 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 02:31:18.071761 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-553d4a83-2a68-4a46-bafd-134fe1e4d05e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Flavor pref 0:0:0 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 02:31:18.072255 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-553d4a83-2a68-4a46-bafd-134fe1e4d05e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Image pref 0:0:0 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 02:31:18.072721 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-553d4a83-2a68-4a46-bafd-134fe1e4d05e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 02:31:18.078882 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2690: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:18.078882 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: user_quotas = model_query(context, models.ProjectUserQuota, Jul 13 02:31:18.083291 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-553d4a83-2a68-4a46-bafd-134fe1e4d05e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:18.083912 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-553d4a83-2a68-4a46-bafd-134fe1e4d05e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:18.084745 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-553d4a83-2a68-4a46-bafd-134fe1e4d05e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:18.085328 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-553d4a83-2a68-4a46-bafd-134fe1e4d05e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:18.089975 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/objects/instance.py:1537: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:18.089975 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: project_result = project_query.first() Jul 13 02:31:18.104291 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2708: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:18.104291 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: rows = model_query(context, models.Quota, read_deleted="no").\ Jul 13 02:31:18.108403 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.quota [None req-553d4a83-2a68-4a46-bafd-134fe1e4d05e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Getting quotas for project 63a044a9d95c49ce9281f67e741cf8ad. Resources: {'ram', 'cores', 'instances'} {{(pid=107262) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 13 02:31:18.112761 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.quota [None req-553d4a83-2a68-4a46-bafd-134fe1e4d05e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Getting quotas for user a5fff5f367864fbb9a8731f6dfbc4d62 and project 63a044a9d95c49ce9281f67e741cf8ad. Resources: {'ram', 'cores', 'instances'} {{(pid=107262) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 13 02:31:18.125422 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-553d4a83-2a68-4a46-bafd-134fe1e4d05e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Going to run 1 instances... {{(pid=107262) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 13 02:31:18.127776 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-553d4a83-2a68-4a46-bafd-134fe1e4d05e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a3efd47-3618-4abd-b00b-a9fa9b90b4d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107262) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 13 02:31:18.176509 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-553d4a83-2a68-4a46-bafd-134fe1e4d05e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.606770 Jul 13 02:31:18.177314 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 338/682] 10.222.0.32 () {62 vars in 1188 bytes} [Tue Jul 13 02:31:17 2021] POST /compute/v2.1/servers => generated 402 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 13 02:31:18.186826 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-d7d4b92a-375f-49d3-9ab9-e0e2655d954e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:18.187444 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-d7d4b92a-375f-49d3-9ab9-e0e2655d954e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:18.264532 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-d7d4b92a-375f-49d3-9ab9-e0e2655d954e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:18.267259 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:18.267259 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:31:18.288053 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-d7d4b92a-375f-49d3-9ab9-e0e2655d954e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:18.289565 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-d7d4b92a-375f-49d3-9ab9-e0e2655d954e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:18.290665 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-d7d4b92a-375f-49d3-9ab9-e0e2655d954e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1281 microversion: 2.20 time: 0.107515 Jul 13 02:31:18.291216 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 345/683] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:31:18 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1281 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:31:19.309571 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-35b128e8-f8e9-4457-8cdd-369c2a283c06 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:19.310275 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-35b128e8-f8e9-4457-8cdd-369c2a283c06 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:19.316256 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-35b128e8-f8e9-4457-8cdd-369c2a283c06 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:19.316708 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-35b128e8-f8e9-4457-8cdd-369c2a283c06 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:19.317519 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-35b128e8-f8e9-4457-8cdd-369c2a283c06 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:19.317984 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-35b128e8-f8e9-4457-8cdd-369c2a283c06 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:19.320998 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:19.320998 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:19.427859 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-35b128e8-f8e9-4457-8cdd-369c2a283c06 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:19.430437 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:19.430437 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:31:19.437786 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-35b128e8-f8e9-4457-8cdd-369c2a283c06 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:19.439379 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-35b128e8-f8e9-4457-8cdd-369c2a283c06 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:19.440978 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-35b128e8-f8e9-4457-8cdd-369c2a283c06 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1341 microversion: 2.20 time: 0.134573 Jul 13 02:31:19.441694 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 339/684] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:31:19 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1341 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:31:20.461015 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-7413f08d-c805-4858-8594-dd33e432d01f tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:20.461623 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-7413f08d-c805-4858-8594-dd33e432d01f tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:20.467505 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7413f08d-c805-4858-8594-dd33e432d01f tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:20.467953 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7413f08d-c805-4858-8594-dd33e432d01f tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:20.468715 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7413f08d-c805-4858-8594-dd33e432d01f tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:20.469151 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7413f08d-c805-4858-8594-dd33e432d01f tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:20.471995 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:20.471995 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:20.572612 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-7413f08d-c805-4858-8594-dd33e432d01f tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:20.575397 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:20.575397 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:31:20.583454 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-7413f08d-c805-4858-8594-dd33e432d01f tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:20.585002 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-7413f08d-c805-4858-8594-dd33e432d01f tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:20.586147 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-7413f08d-c805-4858-8594-dd33e432d01f tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1341 microversion: 2.20 time: 0.129394 Jul 13 02:31:20.586715 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 346/685] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:31:20 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1341 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:31:21.604983 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-29e70897-e5f6-4502-b27c-0bd242e2d7f4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:21.605544 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-29e70897-e5f6-4502-b27c-0bd242e2d7f4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:21.611265 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-29e70897-e5f6-4502-b27c-0bd242e2d7f4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:21.611706 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-29e70897-e5f6-4502-b27c-0bd242e2d7f4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:21.612459 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-29e70897-e5f6-4502-b27c-0bd242e2d7f4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:21.612882 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-29e70897-e5f6-4502-b27c-0bd242e2d7f4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:21.616857 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:21.616857 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:21.714019 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-29e70897-e5f6-4502-b27c-0bd242e2d7f4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:21.716480 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:21.716480 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:31:21.724734 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-29e70897-e5f6-4502-b27c-0bd242e2d7f4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:21.726264 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-29e70897-e5f6-4502-b27c-0bd242e2d7f4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:21.727331 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-29e70897-e5f6-4502-b27c-0bd242e2d7f4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1341 microversion: 2.20 time: 0.126194 Jul 13 02:31:21.727878 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 340/686] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:31:21 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1341 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:31:22.744763 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-6a892445-1d98-469e-b171-3c539c53a38d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:22.745670 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-6a892445-1d98-469e-b171-3c539c53a38d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:22.754314 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6a892445-1d98-469e-b171-3c539c53a38d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:22.754923 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6a892445-1d98-469e-b171-3c539c53a38d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:22.755981 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6a892445-1d98-469e-b171-3c539c53a38d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:22.756677 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6a892445-1d98-469e-b171-3c539c53a38d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:22.760251 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:22.760251 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:23.317767 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-6a892445-1d98-469e-b171-3c539c53a38d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:23.320562 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:23.320562 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:31:23.328373 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-6a892445-1d98-469e-b171-3c539c53a38d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:23.329984 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-6a892445-1d98-469e-b171-3c539c53a38d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:23.331312 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-6a892445-1d98-469e-b171-3c539c53a38d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1407 microversion: 2.20 time: 0.590267 Jul 13 02:31:23.332155 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 347/687] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:31:22 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1407 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:31:23.739207 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-d5d77f29-ba44-48ce-b0dd-13d04935d99d req-fe8558e0-f988-49a4-8e78-c4fa5a304f47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcded031-14e6-4fa5-9a79-7e26c1aa0a0f", "tag": "9e88c5ac-8fb9-44a9-a7fc-b323f20644f2"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:31:23.760256 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:31:23.760256 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:31:23.792921 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-d5d77f29-ba44-48ce-b0dd-13d04935d99d req-fe8558e0-f988-49a4-8e78-c4fa5a304f47 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:23.795329 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-d5d77f29-ba44-48ce-b0dd-13d04935d99d req-fe8558e0-f988-49a4-8e78-c4fa5a304f47 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:23.818717 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-d5d77f29-ba44-48ce-b0dd-13d04935d99d req-fe8558e0-f988-49a4-8e78-c4fa5a304f47 service nova] Creating event network-changed:9e88c5ac-8fb9-44a9-a7fc-b323f20644f2 for instance bcded031-14e6-4fa5-9a79-7e26c1aa0a0f on hv-cinder-78102 Jul 13 02:31:23.825051 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-d5d77f29-ba44-48ce-b0dd-13d04935d99d req-fe8558e0-f988-49a4-8e78-c4fa5a304f47 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092717 Jul 13 02:31:23.826093 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 341/688] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:31:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:31:24.352245 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-f5cc975a-8449-4d4a-95cc-a3d4d4720229 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:24.354166 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-f5cc975a-8449-4d4a-95cc-a3d4d4720229 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:24.360191 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f5cc975a-8449-4d4a-95cc-a3d4d4720229 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:24.364281 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f5cc975a-8449-4d4a-95cc-a3d4d4720229 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:24.365902 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f5cc975a-8449-4d4a-95cc-a3d4d4720229 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:24.366364 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f5cc975a-8449-4d4a-95cc-a3d4d4720229 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:24.369671 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:24.369671 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:24.685492 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-f5cc975a-8449-4d4a-95cc-a3d4d4720229 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:24.688461 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:24.688461 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:31:24.704119 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-f5cc975a-8449-4d4a-95cc-a3d4d4720229 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:24.706111 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-f5cc975a-8449-4d4a-95cc-a3d4d4720229 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:24.708321 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-f5cc975a-8449-4d4a-95cc-a3d4d4720229 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1407 microversion: 2.20 time: 0.361093 Jul 13 02:31:24.709188 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 348/689] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:31:24 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1407 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:31:25.730055 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-030bfd19-9c64-4421-b350-73e4315b5acc tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:25.730942 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-030bfd19-9c64-4421-b350-73e4315b5acc tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:25.737154 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-030bfd19-9c64-4421-b350-73e4315b5acc tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:25.737675 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-030bfd19-9c64-4421-b350-73e4315b5acc tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:25.738601 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-030bfd19-9c64-4421-b350-73e4315b5acc tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:25.739118 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-030bfd19-9c64-4421-b350-73e4315b5acc tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:25.742195 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:25.742195 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:26.059872 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-030bfd19-9c64-4421-b350-73e4315b5acc tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:26.062749 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:26.062749 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:31:26.070612 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-030bfd19-9c64-4421-b350-73e4315b5acc tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:26.072305 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-030bfd19-9c64-4421-b350-73e4315b5acc tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:26.073473 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-030bfd19-9c64-4421-b350-73e4315b5acc tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1407 microversion: 2.20 time: 0.349371 Jul 13 02:31:26.074122 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 342/690] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:31:25 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1407 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:31:27.093004 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-7f267c3b-505a-4c1d-9520-f88980466cb7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:27.094356 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-7f267c3b-505a-4c1d-9520-f88980466cb7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:27.102638 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7f267c3b-505a-4c1d-9520-f88980466cb7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:27.103444 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7f267c3b-505a-4c1d-9520-f88980466cb7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:27.104455 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7f267c3b-505a-4c1d-9520-f88980466cb7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:27.105089 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7f267c3b-505a-4c1d-9520-f88980466cb7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:27.108692 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:27.108692 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:27.415044 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-7f267c3b-505a-4c1d-9520-f88980466cb7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:27.418559 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:27.418559 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:31:27.427041 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-7f267c3b-505a-4c1d-9520-f88980466cb7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:27.428692 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-7f267c3b-505a-4c1d-9520-f88980466cb7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:27.429886 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-7f267c3b-505a-4c1d-9520-f88980466cb7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1407 microversion: 2.20 time: 0.342151 Jul 13 02:31:27.430851 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 349/691] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:31:27 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1407 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:31:28.450920 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-f82dc8dc-465d-4806-b536-25f3a0bba20e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:28.453783 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-f82dc8dc-465d-4806-b536-25f3a0bba20e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:28.464191 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f82dc8dc-465d-4806-b536-25f3a0bba20e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:28.467592 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f82dc8dc-465d-4806-b536-25f3a0bba20e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:28.469428 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f82dc8dc-465d-4806-b536-25f3a0bba20e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:28.471402 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f82dc8dc-465d-4806-b536-25f3a0bba20e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:28.478586 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:28.478586 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:28.818584 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-f82dc8dc-465d-4806-b536-25f3a0bba20e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:28.821447 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:28.821447 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:31:28.831402 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-f82dc8dc-465d-4806-b536-25f3a0bba20e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:28.841877 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-f82dc8dc-465d-4806-b536-25f3a0bba20e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:28.843267 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-f82dc8dc-465d-4806-b536-25f3a0bba20e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1407 microversion: 2.20 time: 0.398506 Jul 13 02:31:28.843864 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 343/692] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:31:28 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1407 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:31:29.862201 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-f4faa874-09bd-4e46-a061-fa2ec027f962 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:29.862826 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-f4faa874-09bd-4e46-a061-fa2ec027f962 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:29.875201 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f4faa874-09bd-4e46-a061-fa2ec027f962 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:29.875855 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f4faa874-09bd-4e46-a061-fa2ec027f962 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:29.879467 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f4faa874-09bd-4e46-a061-fa2ec027f962 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:29.881417 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f4faa874-09bd-4e46-a061-fa2ec027f962 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:29.888427 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:29.888427 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:30.149783 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-f4faa874-09bd-4e46-a061-fa2ec027f962 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:30.153150 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:30.153150 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:31:30.161839 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-f4faa874-09bd-4e46-a061-fa2ec027f962 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:30.163674 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-f4faa874-09bd-4e46-a061-fa2ec027f962 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:30.165046 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-f4faa874-09bd-4e46-a061-fa2ec027f962 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1407 microversion: 2.20 time: 0.307198 Jul 13 02:31:30.166137 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 350/693] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:31:29 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1407 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:31:30.924971 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-3268a379-eb1d-4de6-b7cd-697446c2dca7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:30.925511 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-3268a379-eb1d-4de6-b7cd-697446c2dca7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:30.932760 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3268a379-eb1d-4de6-b7cd-697446c2dca7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:30.933406 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3268a379-eb1d-4de6-b7cd-697446c2dca7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:30.934237 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3268a379-eb1d-4de6-b7cd-697446c2dca7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:30.934857 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3268a379-eb1d-4de6-b7cd-697446c2dca7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:30.938396 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:30.938396 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:31.049676 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-3268a379-eb1d-4de6-b7cd-697446c2dca7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Going to try to terminate instance {{(pid=107262) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 13 02:31:31.053290 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3008: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:31.053290 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).\ Jul 13 02:31:31.071028 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:31.071028 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:31.138662 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/update_match.py:472: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:31.138662 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = query.session.execute(update_stmt) Jul 13 02:31:31.157787 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:530: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:31.157787 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = model_query(context, models.Service, read_deleted="no").\ Jul 13 02:31:31.183741 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-d7a14127-a5d2-48ee-8901-a882eeaf5030 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:31.184311 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-d7a14127-a5d2-48ee-8901-a882eeaf5030 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:31.195720 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d7a14127-a5d2-48ee-8901-a882eeaf5030 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:31.197316 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d7a14127-a5d2-48ee-8901-a882eeaf5030 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:31.198487 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d7a14127-a5d2-48ee-8901-a882eeaf5030 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:31.199185 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d7a14127-a5d2-48ee-8901-a882eeaf5030 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:31.210279 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:31.210279 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:31.227964 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-3268a379-eb1d-4de6-b7cd-697446c2dca7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "DELETE /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 204 len: 0 microversion: 2.1 time: 0.306626 Jul 13 02:31:31.229024 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 344/694] 10.222.0.32 () {58 vars in 1239 bytes} [Tue Jul 13 02:31:30 2021] DELETE /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 13 02:31:31.235489 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-f9f9bcf1-7673-4e60-922d-797faaa5ea33 req-1fefc9b5-57f5-40ef-b22b-997aa176c922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcded031-14e6-4fa5-9a79-7e26c1aa0a0f", "name": "network-vif-plugged", "status": "completed", "tag": "9e88c5ac-8fb9-44a9-a7fc-b323f20644f2"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:31:31.237509 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:31:31.237509 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:31:31.246301 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-f9f9bcf1-7673-4e60-922d-797faaa5ea33 req-1fefc9b5-57f5-40ef-b22b-997aa176c922 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:31.247286 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-f9f9bcf1-7673-4e60-922d-797faaa5ea33 req-1fefc9b5-57f5-40ef-b22b-997aa176c922 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:31.260613 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-f9f9bcf1-7673-4e60-922d-797faaa5ea33 req-1fefc9b5-57f5-40ef-b22b-997aa176c922 service nova] Creating event network-vif-plugged:9e88c5ac-8fb9-44a9-a7fc-b323f20644f2 for instance bcded031-14e6-4fa5-9a79-7e26c1aa0a0f on hv-cinder-78102 Jul 13 02:31:31.266634 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-f9f9bcf1-7673-4e60-922d-797faaa5ea33 req-1fefc9b5-57f5-40ef-b22b-997aa176c922 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035717 Jul 13 02:31:31.267867 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 345/695] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:31:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:31:31.274325 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-a4070795-7539-40d5-8048-7c53fe2d2bef tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:31.275330 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-a4070795-7539-40d5-8048-7c53fe2d2bef tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:31.282248 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a4070795-7539-40d5-8048-7c53fe2d2bef tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:31.282898 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a4070795-7539-40d5-8048-7c53fe2d2bef tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:31.283849 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a4070795-7539-40d5-8048-7c53fe2d2bef tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:31.284436 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a4070795-7539-40d5-8048-7c53fe2d2bef tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:31.289781 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:31.289781 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:32.018999 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-a4070795-7539-40d5-8048-7c53fe2d2bef tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:32.022170 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:32.022170 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:31:32.035777 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-a4070795-7539-40d5-8048-7c53fe2d2bef tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1674 microversion: 2.1 time: 0.765237 Jul 13 02:31:32.038343 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 346/696] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:31:31 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1674 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:31:32.048760 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-d7a14127-a5d2-48ee-8901-a882eeaf5030 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:32.051958 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:32.051958 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:31:32.071716 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-d7a14127-a5d2-48ee-8901-a882eeaf5030 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:32.073785 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-d7a14127-a5d2-48ee-8901-a882eeaf5030 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:32.077588 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-d7a14127-a5d2-48ee-8901-a882eeaf5030 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1407 microversion: 2.20 time: 0.897389 Jul 13 02:31:32.090053 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 351/697] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:31:31 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1407 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:31:33.061778 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-2d46a6c7-dc26-4b6d-bbcd-602c4f259c61 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:33.065247 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-2d46a6c7-dc26-4b6d-bbcd-602c4f259c61 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:33.071973 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2d46a6c7-dc26-4b6d-bbcd-602c4f259c61 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:33.072518 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2d46a6c7-dc26-4b6d-bbcd-602c4f259c61 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:33.073368 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2d46a6c7-dc26-4b6d-bbcd-602c4f259c61 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:33.074085 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2d46a6c7-dc26-4b6d-bbcd-602c4f259c61 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:33.077305 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:33.077305 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:33.100838 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-bcfe1596-0fa4-40b1-8566-841a7466dbaa tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:33.101669 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-bcfe1596-0fa4-40b1-8566-841a7466dbaa tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:33.108977 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-bcfe1596-0fa4-40b1-8566-841a7466dbaa tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:33.109580 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-bcfe1596-0fa4-40b1-8566-841a7466dbaa tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:33.110497 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-bcfe1596-0fa4-40b1-8566-841a7466dbaa tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:33.111179 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-bcfe1596-0fa4-40b1-8566-841a7466dbaa tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:33.115181 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:33.115181 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:33.543601 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-bcfe1596-0fa4-40b1-8566-841a7466dbaa tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:33.549846 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:33.549846 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:31:33.594234 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-bcfe1596-0fa4-40b1-8566-841a7466dbaa tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:33.598404 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-bcfe1596-0fa4-40b1-8566-841a7466dbaa tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:33.600012 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-bcfe1596-0fa4-40b1-8566-841a7466dbaa tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1407 microversion: 2.20 time: 0.503302 Jul 13 02:31:33.600952 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 352/698] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:31:33 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1407 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:31:33.837530 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-2d46a6c7-dc26-4b6d-bbcd-602c4f259c61 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:33.840083 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:33.840083 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:31:33.852625 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-2d46a6c7-dc26-4b6d-bbcd-602c4f259c61 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1674 microversion: 2.1 time: 0.801364 Jul 13 02:31:33.853061 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 347/699] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:31:33 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1674 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:31:34.619335 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-2d693b8b-61f6-4f61-a787-bb3117408b6c tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:34.619951 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-2d693b8b-61f6-4f61-a787-bb3117408b6c tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:34.629070 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2d693b8b-61f6-4f61-a787-bb3117408b6c tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:34.629505 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2d693b8b-61f6-4f61-a787-bb3117408b6c tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:34.632852 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2d693b8b-61f6-4f61-a787-bb3117408b6c tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:34.633332 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2d693b8b-61f6-4f61-a787-bb3117408b6c tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:34.640553 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:34.640553 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:34.875145 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-ecd63fe7-19e0-4e04-ba9c-2f0d6dc3b81f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:34.875777 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-ecd63fe7-19e0-4e04-ba9c-2f0d6dc3b81f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:34.898305 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ecd63fe7-19e0-4e04-ba9c-2f0d6dc3b81f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:34.903129 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ecd63fe7-19e0-4e04-ba9c-2f0d6dc3b81f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:34.906400 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ecd63fe7-19e0-4e04-ba9c-2f0d6dc3b81f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:34.913977 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ecd63fe7-19e0-4e04-ba9c-2f0d6dc3b81f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:34.929192 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:34.929192 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:35.345816 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-2d693b8b-61f6-4f61-a787-bb3117408b6c tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:35.349355 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:35.349355 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:31:35.367652 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-2d693b8b-61f6-4f61-a787-bb3117408b6c tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:35.377543 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-2d693b8b-61f6-4f61-a787-bb3117408b6c tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:35.379960 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-2d693b8b-61f6-4f61-a787-bb3117408b6c tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1599 microversion: 2.20 time: 0.763724 Jul 13 02:31:35.393965 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 353/700] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:31:34 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1599 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:31:35.400129 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-08d50ea1-67b8-4798-9ec4-86b03ec50994 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:35.400633 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-08d50ea1-67b8-4798-9ec4-86b03ec50994 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:35.410889 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-08d50ea1-67b8-4798-9ec4-86b03ec50994 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:35.411498 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-08d50ea1-67b8-4798-9ec4-86b03ec50994 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:35.412285 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-08d50ea1-67b8-4798-9ec4-86b03ec50994 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:35.416620 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-08d50ea1-67b8-4798-9ec4-86b03ec50994 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:35.448776 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:35.448776 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:35.714281 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-ecd63fe7-19e0-4e04-ba9c-2f0d6dc3b81f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:35.716995 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:35.716995 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:31:35.735329 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-ecd63fe7-19e0-4e04-ba9c-2f0d6dc3b81f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1674 microversion: 2.1 time: 0.865805 Jul 13 02:31:35.736220 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 348/701] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:31:34 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1674 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:31:35.877774 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-08d50ea1-67b8-4798-9ec4-86b03ec50994 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.481657 Jul 13 02:31:35.878394 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 354/702] 10.222.0.32 () {60 vars in 1316 bytes} [Tue Jul 13 02:31:35 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/os-interface => generated 285 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:31:36.752223 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-2e36cbe8-bfb4-499e-92e7-741b77302a2a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:36.752833 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-2e36cbe8-bfb4-499e-92e7-741b77302a2a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:36.773949 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2e36cbe8-bfb4-499e-92e7-741b77302a2a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:36.774422 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2e36cbe8-bfb4-499e-92e7-741b77302a2a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:36.775211 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2e36cbe8-bfb4-499e-92e7-741b77302a2a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:36.775640 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2e36cbe8-bfb4-499e-92e7-741b77302a2a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:36.780503 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:36.780503 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:36.866644 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [req-2102253c-d382-43ac-b52c-0c3f3922f267 req-0042cc96-2ddd-47c9-941d-d1c27355f7be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8f2132c-4b9b-4c53-81c5-29e734143042", "name": "network-vif-deleted", "tag": "4d10eb36-dce1-4c00-9fa1-a89e70dddb17"}]} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:31:36.868557 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:31:36.868557 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: warnings.warn(msg) Jul 13 02:31:36.888931 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-2102253c-d382-43ac-b52c-0c3f3922f267 req-0042cc96-2ddd-47c9-941d-d1c27355f7be service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:36.889690 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-2102253c-d382-43ac-b52c-0c3f3922f267 req-0042cc96-2ddd-47c9-941d-d1c27355f7be service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:36.920145 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.compute.server_external_events [req-2102253c-d382-43ac-b52c-0c3f3922f267 req-0042cc96-2ddd-47c9-941d-d1c27355f7be service nova] Creating event network-vif-deleted:4d10eb36-dce1-4c00-9fa1-a89e70dddb17 for instance c8f2132c-4b9b-4c53-81c5-29e734143042 on hv-cinder-78102 Jul 13 02:31:36.938352 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [req-2102253c-d382-43ac-b52c-0c3f3922f267 req-0042cc96-2ddd-47c9-941d-d1c27355f7be service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070986 Jul 13 02:31:36.943765 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 355/703] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:31:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:31:37.189592 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-2e36cbe8-bfb4-499e-92e7-741b77302a2a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:37.196791 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:37.196791 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:31:37.211732 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-2e36cbe8-bfb4-499e-92e7-741b77302a2a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 200 len: 1606 microversion: 2.1 time: 0.463065 Jul 13 02:31:37.212321 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 349/704] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:31:36 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 1606 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:31:38.231259 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-55f874b3-5583-459f-9d80-c115767566c6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:38.232610 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-55f874b3-5583-459f-9d80-c115767566c6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:38.241666 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-55f874b3-5583-459f-9d80-c115767566c6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:38.242429 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-55f874b3-5583-459f-9d80-c115767566c6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:38.243404 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-55f874b3-5583-459f-9d80-c115767566c6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:38.244005 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-55f874b3-5583-459f-9d80-c115767566c6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:38.248290 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:38.248290 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:38.303220 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.wsgi [None req-55f874b3-5583-459f-9d80-c115767566c6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] HTTP exception thrown: Instance c8f2132c-4b9b-4c53-81c5-29e734143042 could not be found. Jul 13 02:31:38.304230 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-55f874b3-5583-459f-9d80-c115767566c6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Returning 404 to user: Instance c8f2132c-4b9b-4c53-81c5-29e734143042 could not be found. {{(pid=107263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:31:38.306440 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-55f874b3-5583-459f-9d80-c115767566c6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 404 len: 111 microversion: 2.1 time: 0.080472 Jul 13 02:31:38.307687 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 356/705] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:31:38 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 02:31:38.317391 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-0ab04fea-1bb3-4b81-b8ae-4815cbd03c58 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '.version_select at 0x7f431396ca60>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:38.338841 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-0ab04fea-1bb3-4b81-b8ae-4815cbd03c58 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1290995771" status: 202 len: 0 microversion: 2.1 time: 0.026250 Jul 13 02:31:38.340875 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 350/706] 10.222.0.32 () {58 vars in 1221 bytes} [Tue Jul 13 02:31:38 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1290995771 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:31:39.054521 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-972df876-e870-4a13-8a2e-19c73a1e9b97 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:31:39.055621 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-972df876-e870-4a13-8a2e-19c73a1e9b97 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:39.062365 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-3be759ee-a853-48ac-90db-7ed6094b2a99 req-ab3104da-e72f-45dc-a5ce-db6153072a3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcded031-14e6-4fa5-9a79-7e26c1aa0a0f", "tag": "9e88c5ac-8fb9-44a9-a7fc-b323f20644f2"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:31:39.064092 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:31:39.064092 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:31:39.085189 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-972df876-e870-4a13-8a2e-19c73a1e9b97 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:39.090402 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-3be759ee-a853-48ac-90db-7ed6094b2a99 req-ab3104da-e72f-45dc-a5ce-db6153072a3b service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:39.090854 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-3be759ee-a853-48ac-90db-7ed6094b2a99 req-ab3104da-e72f-45dc-a5ce-db6153072a3b service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:39.095848 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-972df876-e870-4a13-8a2e-19c73a1e9b97 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:39.096708 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-972df876-e870-4a13-8a2e-19c73a1e9b97 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:39.097148 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-972df876-e870-4a13-8a2e-19c73a1e9b97 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:39.107793 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:39.107793 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:39.135935 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-3be759ee-a853-48ac-90db-7ed6094b2a99 req-ab3104da-e72f-45dc-a5ce-db6153072a3b service nova] Creating event network-changed:9e88c5ac-8fb9-44a9-a7fc-b323f20644f2 for instance bcded031-14e6-4fa5-9a79-7e26c1aa0a0f on hv-cinder-78102 Jul 13 02:31:39.150480 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-3be759ee-a853-48ac-90db-7ed6094b2a99 req-ab3104da-e72f-45dc-a5ce-db6153072a3b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091691 Jul 13 02:31:39.156168 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 351/707] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:31:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 02:31:39.343593 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-972df876-e870-4a13-8a2e-19c73a1e9b97 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action" status: 200 len: 14 microversion: 2.20 time: 0.293584 Jul 13 02:31:39.345708 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 357/708] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:31:39 2021] POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action => generated 14 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:31:40.308974 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-bc0ba3c5-e791-45ac-9f96-128bf417fee2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'create', calling method: .version_select at 0x7f43130c6e50>, body: {"keypair": {"name": "tempest-keypair-1319201673"}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:31:40.314761 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fde8e23d-5763-437f-90c7-2cd0eebfc6a8] AMQP server on 10.222.0.32:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 13 02:31:40.322108 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2656: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:40.322108 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return model_query(context, models.KeyPair, read_deleted="no").\ Jul 13 02:31:40.334118 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2708: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:40.334118 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: rows = model_query(context, models.Quota, read_deleted="no").\ Jul 13 02:31:40.338435 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.quota [None req-bc0ba3c5-e791-45ac-9f96-128bf417fee2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Getting quotas for project 197b525e7a104e5ebcd262a734055741. Resources: {'key_pairs'} {{(pid=107262) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 13 02:31:40.344309 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.quota [None req-bc0ba3c5-e791-45ac-9f96-128bf417fee2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Getting quotas for user 1d3696355aae4727ae610990c9efb5eb and project 197b525e7a104e5ebcd262a734055741. Resources: {'key_pairs'} {{(pid=107262) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 13 02:31:40.355466 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-a2eec9bf-be02-4b6e-9063-9fb34d3a7a06 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:31:40.356746 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-a2eec9bf-be02-4b6e-9063-9fb34d3a7a06 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:40.366186 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a2eec9bf-be02-4b6e-9063-9fb34d3a7a06 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:40.367357 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2690: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:40.367357 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: user_quotas = model_query(context, models.ProjectUserQuota, Jul 13 02:31:40.368679 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a2eec9bf-be02-4b6e-9063-9fb34d3a7a06 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:40.378484 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a2eec9bf-be02-4b6e-9063-9fb34d3a7a06 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:40.380029 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a2eec9bf-be02-4b6e-9063-9fb34d3a7a06 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:40.390880 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:40.390880 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:40.562206 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-a2eec9bf-be02-4b6e-9063-9fb34d3a7a06 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action" status: 200 len: 14 microversion: 2.20 time: 0.210576 Jul 13 02:31:40.569140 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 358/709] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:31:40 2021] POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action => generated 14 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:31:40.982345 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2621: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:40.982345 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = model_query(context, models.KeyPair).\ Jul 13 02:31:41.017195 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.quota [None req-bc0ba3c5-e791-45ac-9f96-128bf417fee2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Getting quotas for project 197b525e7a104e5ebcd262a734055741. Resources: {'key_pairs'} {{(pid=107262) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 13 02:31:41.021675 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.quota [None req-bc0ba3c5-e791-45ac-9f96-128bf417fee2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Getting quotas for user 1d3696355aae4727ae610990c9efb5eb and project 197b525e7a104e5ebcd262a734055741. Resources: {'key_pairs'} {{(pid=107262) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 13 02:31:41.037572 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-bc0ba3c5-e791-45ac-9f96-128bf417fee2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.741258 Jul 13 02:31:41.038699 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 352/710] 10.222.0.32 () {60 vars in 1158 bytes} [Tue Jul 13 02:31:40 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:31:41.585376 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-e7838ee2-f2c7-4e65-b3bb-10c70b3d4d90 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:31:41.586384 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-e7838ee2-f2c7-4e65-b3bb-10c70b3d4d90 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:41.596629 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e7838ee2-f2c7-4e65-b3bb-10c70b3d4d90 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:41.599013 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e7838ee2-f2c7-4e65-b3bb-10c70b3d4d90 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:41.600170 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e7838ee2-f2c7-4e65-b3bb-10c70b3d4d90 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:41.602492 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e7838ee2-f2c7-4e65-b3bb-10c70b3d4d90 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:41.607316 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:41.607316 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:41.806145 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-e7838ee2-f2c7-4e65-b3bb-10c70b3d4d90 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action" status: 200 len: 14 microversion: 2.20 time: 0.225025 Jul 13 02:31:41.807187 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 359/711] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:31:41 2021] POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action => generated 14 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:31:42.829017 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-8370561e-8966-44aa-9cf4-43818c6626f9 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:31:42.830655 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-8370561e-8966-44aa-9cf4-43818c6626f9 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:42.840378 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8370561e-8966-44aa-9cf4-43818c6626f9 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:42.840736 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8370561e-8966-44aa-9cf4-43818c6626f9 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:42.844896 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8370561e-8966-44aa-9cf4-43818c6626f9 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:42.846611 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8370561e-8966-44aa-9cf4-43818c6626f9 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:42.851032 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO oslo.messaging._drivers.impl_rabbit [-] [fde8e23d-5763-437f-90c7-2cd0eebfc6a8] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 41044. Jul 13 02:31:42.855602 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:42.855602 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:43.003396 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-8370561e-8966-44aa-9cf4-43818c6626f9 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action" status: 200 len: 14 microversion: 2.20 time: 0.189068 Jul 13 02:31:43.004293 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 353/712] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:31:42 2021] POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action => generated 14 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:31:43.596056 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-33732f3f-fd9f-4efc-a29d-b334f886e822 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1583316538", "imageRef": "1a3efd47-3618-4abd-b00b-a9fa9b90b4d4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c480eb56-38cb-46d3-accb-fb773d7ee254"}], "security_groups": [{"name": "tempest-securitygroup--1170027541"}], "key_name": "tempest-keypair-1319201673", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:31:43.744661 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.network.neutron [None req-33732f3f-fd9f-4efc-a29d-b334f886e822 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] validate_networks() for [('c480eb56-38cb-46d3-accb-fb773d7ee254', None, None, None)] {{(pid=107263) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Jul 13 02:31:44.020517 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-2a730e1f-b2d6-4bb6-80f5-76d880697d26 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:31:44.021805 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-2a730e1f-b2d6-4bb6-80f5-76d880697d26 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:44.032754 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2a730e1f-b2d6-4bb6-80f5-76d880697d26 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:44.036750 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2a730e1f-b2d6-4bb6-80f5-76d880697d26 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:44.038009 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2a730e1f-b2d6-4bb6-80f5-76d880697d26 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:44.038626 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2a730e1f-b2d6-4bb6-80f5-76d880697d26 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:44.042008 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:44.042008 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:44.235970 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-2a730e1f-b2d6-4bb6-80f5-76d880697d26 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action" status: 200 len: 14 microversion: 2.20 time: 0.222826 Jul 13 02:31:44.236608 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 354/713] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:31:44 2021] POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action => generated 14 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:31:44.336952 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-33732f3f-fd9f-4efc-a29d-b334f886e822 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Flavor limits 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 02:31:44.337388 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-33732f3f-fd9f-4efc-a29d-b334f886e822 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Image limits 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 02:31:44.338008 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-33732f3f-fd9f-4efc-a29d-b334f886e822 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Flavor pref 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 02:31:44.338641 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-33732f3f-fd9f-4efc-a29d-b334f886e822 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Image pref 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 02:31:44.339059 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-33732f3f-fd9f-4efc-a29d-b334f886e822 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 02:31:44.347882 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2690: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:44.347882 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: user_quotas = model_query(context, models.ProjectUserQuota, Jul 13 02:31:44.352911 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-33732f3f-fd9f-4efc-a29d-b334f886e822 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:44.353357 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-33732f3f-fd9f-4efc-a29d-b334f886e822 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:44.354191 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-33732f3f-fd9f-4efc-a29d-b334f886e822 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:44.356286 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-33732f3f-fd9f-4efc-a29d-b334f886e822 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:44.361492 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/objects/instance.py:1537: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:44.361492 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: project_result = project_query.first() Jul 13 02:31:44.380259 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2708: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:44.380259 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: rows = model_query(context, models.Quota, read_deleted="no").\ Jul 13 02:31:44.387129 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.quota [None req-33732f3f-fd9f-4efc-a29d-b334f886e822 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Getting quotas for project 197b525e7a104e5ebcd262a734055741. Resources: {'ram', 'cores', 'instances'} {{(pid=107263) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 13 02:31:44.392163 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.quota [None req-33732f3f-fd9f-4efc-a29d-b334f886e822 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Getting quotas for user 1d3696355aae4727ae610990c9efb5eb and project 197b525e7a104e5ebcd262a734055741. Resources: {'ram', 'cores', 'instances'} {{(pid=107263) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 13 02:31:44.406159 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-33732f3f-fd9f-4efc-a29d-b334f886e822 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Going to run 1 instances... {{(pid=107263) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 13 02:31:44.408584 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-33732f3f-fd9f-4efc-a29d-b334f886e822 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a3efd47-3618-4abd-b00b-a9fa9b90b4d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 13 02:31:44.496295 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-33732f3f-fd9f-4efc-a29d-b334f886e822 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.904853 Jul 13 02:31:44.499706 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 360/714] 10.222.0.32 () {60 vars in 1147 bytes} [Tue Jul 13 02:31:43 2021] POST /compute/v2.1/servers => generated 402 bytes in 909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 02:31:44.507845 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-a2f5dec2-36df-4769-a30c-d9cf54b7d6b7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:44.511026 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-a2f5dec2-36df-4769-a30c-d9cf54b7d6b7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:44.652279 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-a2f5dec2-36df-4769-a30c-d9cf54b7d6b7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:44.655109 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:44.655109 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:31:44.669123 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-a2f5dec2-36df-4769-a30c-d9cf54b7d6b7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5" status: 200 len: 1238 microversion: 2.1 time: 0.165306 Jul 13 02:31:44.678195 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 355/715] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:31:44 2021] GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5 => generated 1238 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:31:45.248928 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-efcc9b62-9cdb-4b15-b08b-2be422de0921 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:31:45.250687 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-efcc9b62-9cdb-4b15-b08b-2be422de0921 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:45.273700 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-efcc9b62-9cdb-4b15-b08b-2be422de0921 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:45.274350 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-efcc9b62-9cdb-4b15-b08b-2be422de0921 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:45.277758 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-efcc9b62-9cdb-4b15-b08b-2be422de0921 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:45.278285 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-efcc9b62-9cdb-4b15-b08b-2be422de0921 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:45.281883 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:45.281883 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:45.430323 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-efcc9b62-9cdb-4b15-b08b-2be422de0921 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action" status: 200 len: 14 microversion: 2.20 time: 0.186399 Jul 13 02:31:45.431208 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 361/716] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:31:45 2021] POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action => generated 14 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:31:45.685065 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-312fc7c1-3b86-4393-8bc6-d517c74ee4ce tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:45.685677 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-312fc7c1-3b86-4393-8bc6-d517c74ee4ce tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:45.696865 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-312fc7c1-3b86-4393-8bc6-d517c74ee4ce tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:45.697308 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-312fc7c1-3b86-4393-8bc6-d517c74ee4ce tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:45.706158 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-312fc7c1-3b86-4393-8bc6-d517c74ee4ce tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:45.707298 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-312fc7c1-3b86-4393-8bc6-d517c74ee4ce tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:45.715545 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:45.715545 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:45.871767 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-312fc7c1-3b86-4393-8bc6-d517c74ee4ce tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:45.875082 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:45.875082 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:31:45.883891 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-312fc7c1-3b86-4393-8bc6-d517c74ee4ce tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5" status: 200 len: 1290 microversion: 2.1 time: 0.202350 Jul 13 02:31:45.885446 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 356/717] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:31:45 2021] GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5 => generated 1290 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:31:46.443615 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-d53d90be-8bde-4cce-8784-3d476a2afdbb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:31:46.446406 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-d53d90be-8bde-4cce-8784-3d476a2afdbb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:46.454835 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d53d90be-8bde-4cce-8784-3d476a2afdbb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:46.455648 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d53d90be-8bde-4cce-8784-3d476a2afdbb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:46.457536 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d53d90be-8bde-4cce-8784-3d476a2afdbb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:46.459413 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d53d90be-8bde-4cce-8784-3d476a2afdbb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:46.465367 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:46.465367 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:46.611435 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-d53d90be-8bde-4cce-8784-3d476a2afdbb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action" status: 200 len: 8104 microversion: 2.20 time: 0.174001 Jul 13 02:31:46.612838 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 362/718] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:31:46 2021] POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action => generated 8104 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:31:46.901549 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-28e50194-ff72-4ecc-95ef-e29ccb11821d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:46.902191 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-28e50194-ff72-4ecc-95ef-e29ccb11821d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:46.910302 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-28e50194-ff72-4ecc-95ef-e29ccb11821d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:46.910762 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-28e50194-ff72-4ecc-95ef-e29ccb11821d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:46.911551 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-28e50194-ff72-4ecc-95ef-e29ccb11821d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:46.911990 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-28e50194-ff72-4ecc-95ef-e29ccb11821d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:46.917567 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:46.917567 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:47.244589 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-28e50194-ff72-4ecc-95ef-e29ccb11821d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:47.247673 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:47.247673 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:31:47.256661 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-28e50194-ff72-4ecc-95ef-e29ccb11821d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5" status: 200 len: 1364 microversion: 2.1 time: 0.359209 Jul 13 02:31:47.260041 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 357/719] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:31:46 2021] GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5 => generated 1364 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:31:47.623878 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-ae41a484-61dc-4519-aee3-2411f38101ad tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:31:47.625205 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-ae41a484-61dc-4519-aee3-2411f38101ad tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:47.633437 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ae41a484-61dc-4519-aee3-2411f38101ad tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:47.637697 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ae41a484-61dc-4519-aee3-2411f38101ad tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:47.638801 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ae41a484-61dc-4519-aee3-2411f38101ad tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:47.639411 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ae41a484-61dc-4519-aee3-2411f38101ad tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:47.642753 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:47.642753 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:47.813084 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-ae41a484-61dc-4519-aee3-2411f38101ad tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action" status: 200 len: 16196 microversion: 2.20 time: 0.193195 Jul 13 02:31:47.814529 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 363/720] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:31:47 2021] POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action => generated 16196 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 13 02:31:47.886856 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-69649a29-b887-443d-b275-805cc4cca688 req-f63d9423-f308-4359-b8e8-e694e178073d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "358bc320-a9f0-47c9-aae8-72c8c45102f5", "tag": "2f2dc5f8-6784-45e5-8b42-42c216edcb56"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:31:47.888994 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:31:47.888994 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:31:47.906798 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-69649a29-b887-443d-b275-805cc4cca688 req-f63d9423-f308-4359-b8e8-e694e178073d service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:47.910822 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-69649a29-b887-443d-b275-805cc4cca688 req-f63d9423-f308-4359-b8e8-e694e178073d service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:47.938597 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-69649a29-b887-443d-b275-805cc4cca688 req-f63d9423-f308-4359-b8e8-e694e178073d service nova] Creating event network-changed:2f2dc5f8-6784-45e5-8b42-42c216edcb56 for instance 358bc320-a9f0-47c9-aae8-72c8c45102f5 on hv-cinder-78102 Jul 13 02:31:47.944149 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-69649a29-b887-443d-b275-805cc4cca688 req-f63d9423-f308-4359-b8e8-e694e178073d service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065814 Jul 13 02:31:47.945312 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 358/721] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:31:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 02:31:48.276765 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-bc40801b-c569-41b0-b42e-0da3ce14adc1 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:48.279821 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-bc40801b-c569-41b0-b42e-0da3ce14adc1 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:48.287206 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-bc40801b-c569-41b0-b42e-0da3ce14adc1 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:48.287936 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-bc40801b-c569-41b0-b42e-0da3ce14adc1 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:48.288910 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-bc40801b-c569-41b0-b42e-0da3ce14adc1 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:48.289907 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-bc40801b-c569-41b0-b42e-0da3ce14adc1 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:48.293516 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:48.293516 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:48.558284 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-bc40801b-c569-41b0-b42e-0da3ce14adc1 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:48.561295 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:48.561295 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:31:48.572780 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-bc40801b-c569-41b0-b42e-0da3ce14adc1 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5" status: 200 len: 1364 microversion: 2.1 time: 0.300112 Jul 13 02:31:48.573691 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 364/722] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:31:48 2021] GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5 => generated 1364 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:31:48.825135 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-e050e92a-fa37-429f-ae0b-3ec5cea70fcf tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:31:48.826426 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-e050e92a-fa37-429f-ae0b-3ec5cea70fcf tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:48.833267 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e050e92a-fa37-429f-ae0b-3ec5cea70fcf tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:48.833981 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e050e92a-fa37-429f-ae0b-3ec5cea70fcf tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:48.835012 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e050e92a-fa37-429f-ae0b-3ec5cea70fcf tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:48.835595 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e050e92a-fa37-429f-ae0b-3ec5cea70fcf tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:48.839031 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:48.839031 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:48.990624 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-e050e92a-fa37-429f-ae0b-3ec5cea70fcf tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action" status: 200 len: 18561 microversion: 2.20 time: 0.169290 Jul 13 02:31:48.993134 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 359/723] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:31:48 2021] POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action => generated 18561 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:31:49.590573 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-d49bb760-6307-45b4-bb64-9ef83e80d86a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:49.592064 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-d49bb760-6307-45b4-bb64-9ef83e80d86a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:49.600480 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d49bb760-6307-45b4-bb64-9ef83e80d86a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:49.601144 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d49bb760-6307-45b4-bb64-9ef83e80d86a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:49.607185 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d49bb760-6307-45b4-bb64-9ef83e80d86a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:49.607925 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d49bb760-6307-45b4-bb64-9ef83e80d86a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:49.611053 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:49.611053 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:49.808374 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-d49bb760-6307-45b4-bb64-9ef83e80d86a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:49.811550 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:49.811550 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:31:49.818640 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-d49bb760-6307-45b4-bb64-9ef83e80d86a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5" status: 200 len: 1364 microversion: 2.1 time: 0.231823 Jul 13 02:31:49.828191 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 365/724] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:31:49 2021] GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5 => generated 1364 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:31:50.005247 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-10ea84f2-00b8-402a-bb3c-7244c94258a2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:31:50.006590 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-10ea84f2-00b8-402a-bb3c-7244c94258a2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:50.014124 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-10ea84f2-00b8-402a-bb3c-7244c94258a2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:50.014574 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-10ea84f2-00b8-402a-bb3c-7244c94258a2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:50.015359 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-10ea84f2-00b8-402a-bb3c-7244c94258a2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:50.015788 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-10ea84f2-00b8-402a-bb3c-7244c94258a2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:50.019478 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:50.019478 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:50.174110 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-10ea84f2-00b8-402a-bb3c-7244c94258a2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action" status: 200 len: 20997 microversion: 2.20 time: 0.174128 Jul 13 02:31:50.175645 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 360/725] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:31:49 2021] POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action => generated 20997 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:31:50.640992 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-ef48291d-b510-483e-b13a-a24a7c2c64ae tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Action: 'create', calling method: .version_select at 0x7f4312d9c040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1376153643"}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:31:50.649898 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2656: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:50.649898 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return model_query(context, models.KeyPair, read_deleted="no").\ Jul 13 02:31:50.660200 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2708: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:50.660200 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: rows = model_query(context, models.Quota, read_deleted="no").\ Jul 13 02:31:50.664322 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.quota [None req-ef48291d-b510-483e-b13a-a24a7c2c64ae tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Getting quotas for project d9e51bf2b24e42b7b4bad3a25ff6f564. Resources: {'key_pairs'} {{(pid=107263) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 13 02:31:50.668028 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.quota [None req-ef48291d-b510-483e-b13a-a24a7c2c64ae tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Getting quotas for user 6963a1e2b294477c9eb4c28dd9348f9a and project d9e51bf2b24e42b7b4bad3a25ff6f564. Resources: {'key_pairs'} {{(pid=107263) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 13 02:31:50.672965 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2690: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:50.672965 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: user_quotas = model_query(context, models.ProjectUserQuota, Jul 13 02:31:50.763858 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2621: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:50.763858 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = model_query(context, models.KeyPair).\ Jul 13 02:31:50.792908 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.quota [None req-ef48291d-b510-483e-b13a-a24a7c2c64ae tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Getting quotas for project d9e51bf2b24e42b7b4bad3a25ff6f564. Resources: {'key_pairs'} {{(pid=107263) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 13 02:31:50.796594 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.quota [None req-ef48291d-b510-483e-b13a-a24a7c2c64ae tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Getting quotas for user 6963a1e2b294477c9eb4c28dd9348f9a and project d9e51bf2b24e42b7b4bad3a25ff6f564. Resources: {'key_pairs'} {{(pid=107263) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 13 02:31:50.810768 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-ef48291d-b510-483e-b13a-a24a7c2c64ae tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.173677 Jul 13 02:31:50.811367 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 366/726] 10.222.0.32 () {60 vars in 1158 bytes} [Tue Jul 13 02:31:50 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:31:50.836297 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-7390f249-ff3f-4237-908e-8b4495e22d70 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:50.837001 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-7390f249-ff3f-4237-908e-8b4495e22d70 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:50.844528 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7390f249-ff3f-4237-908e-8b4495e22d70 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:50.844973 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7390f249-ff3f-4237-908e-8b4495e22d70 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:50.845744 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7390f249-ff3f-4237-908e-8b4495e22d70 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:50.846209 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7390f249-ff3f-4237-908e-8b4495e22d70 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:50.850136 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:50.850136 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:50.915506 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-b518b053-a341-4206-abdc-18d6a6b336bf tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-115892733", "imageRef": "1b21f45d-972f-4a89-86f2-9e7822e55fe9", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1376153643", "networks": [{"uuid": "acf40587-1b21-48e9-87d9-59aef421a5ba"}]}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:31:50.971132 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.network.neutron [None req-b518b053-a341-4206-abdc-18d6a6b336bf tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] validate_networks() for [('acf40587-1b21-48e9-87d9-59aef421a5ba', None, None, None)] {{(pid=107263) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Jul 13 02:31:51.148852 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-7390f249-ff3f-4237-908e-8b4495e22d70 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:51.151480 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:51.151480 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:31:51.158791 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-7390f249-ff3f-4237-908e-8b4495e22d70 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5" status: 200 len: 1364 microversion: 2.1 time: 0.327061 Jul 13 02:31:51.159550 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 361/727] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:31:50 2021] GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5 => generated 1364 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:31:51.186204 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-a6edb07a-38d3-4ae0-bb25-486d4c18b01e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:31:51.187254 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-a6edb07a-38d3-4ae0-bb25-486d4c18b01e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:51.195048 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a6edb07a-38d3-4ae0-bb25-486d4c18b01e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:51.195718 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a6edb07a-38d3-4ae0-bb25-486d4c18b01e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:51.196583 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a6edb07a-38d3-4ae0-bb25-486d4c18b01e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:51.197201 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a6edb07a-38d3-4ae0-bb25-486d4c18b01e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:51.214713 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:51.214713 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:51.418239 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-b518b053-a341-4206-abdc-18d6a6b336bf tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Flavor limits 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 02:31:51.418688 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-b518b053-a341-4206-abdc-18d6a6b336bf tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Image limits 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 02:31:51.419164 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-b518b053-a341-4206-abdc-18d6a6b336bf tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Flavor pref 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 02:31:51.419573 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-b518b053-a341-4206-abdc-18d6a6b336bf tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Image pref 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 02:31:51.419988 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-b518b053-a341-4206-abdc-18d6a6b336bf tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 02:31:51.426716 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2690: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:51.426716 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: user_quotas = model_query(context, models.ProjectUserQuota, Jul 13 02:31:51.430463 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b518b053-a341-4206-abdc-18d6a6b336bf tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:51.430903 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b518b053-a341-4206-abdc-18d6a6b336bf tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:51.431695 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b518b053-a341-4206-abdc-18d6a6b336bf tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:51.432122 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b518b053-a341-4206-abdc-18d6a6b336bf tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:51.436692 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/objects/instance.py:1537: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:51.436692 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: project_result = project_query.first() Jul 13 02:31:51.449377 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2708: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:51.449377 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: rows = model_query(context, models.Quota, read_deleted="no").\ Jul 13 02:31:51.452891 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.quota [None req-b518b053-a341-4206-abdc-18d6a6b336bf tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Getting quotas for project d9e51bf2b24e42b7b4bad3a25ff6f564. Resources: {'ram', 'cores', 'instances'} {{(pid=107263) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 13 02:31:51.456832 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.quota [None req-b518b053-a341-4206-abdc-18d6a6b336bf tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Getting quotas for user 6963a1e2b294477c9eb4c28dd9348f9a and project d9e51bf2b24e42b7b4bad3a25ff6f564. Resources: {'ram', 'cores', 'instances'} {{(pid=107263) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 13 02:31:51.468084 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-b518b053-a341-4206-abdc-18d6a6b336bf tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Going to run 1 instances... {{(pid=107263) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 13 02:31:51.470314 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-b518b053-a341-4206-abdc-18d6a6b336bf tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1b21f45d-972f-4a89-86f2-9e7822e55fe9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 13 02:31:51.518425 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-b518b053-a341-4206-abdc-18d6a6b336bf tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.606911 Jul 13 02:31:51.519093 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 367/728] 10.222.0.32 () {60 vars in 1147 bytes} [Tue Jul 13 02:31:50 2021] POST /compute/v2.1/servers => generated 380 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 13 02:31:51.528522 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-970eb233-389d-4e94-a662-a6136bb096c5 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:51.529130 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-970eb233-389d-4e94-a662-a6136bb096c5 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:51.581826 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-970eb233-389d-4e94-a662-a6136bb096c5 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:51.584587 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:51.584587 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:31:51.591342 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-970eb233-389d-4e94-a662-a6136bb096c5 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1258 microversion: 2.1 time: 0.066299 Jul 13 02:31:51.591902 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 368/729] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:31:51 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1258 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:31:52.175885 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-5b0ab986-a4c7-4481-9696-d0a03e4997a2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:52.176538 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-5b0ab986-a4c7-4481-9696-d0a03e4997a2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:52.183132 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5b0ab986-a4c7-4481-9696-d0a03e4997a2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:52.183580 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5b0ab986-a4c7-4481-9696-d0a03e4997a2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:52.184441 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5b0ab986-a4c7-4481-9696-d0a03e4997a2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:52.184876 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5b0ab986-a4c7-4481-9696-d0a03e4997a2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:52.188453 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:52.188453 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:52.356444 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-5b0ab986-a4c7-4481-9696-d0a03e4997a2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:52.359026 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:52.359026 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:31:52.366148 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-5b0ab986-a4c7-4481-9696-d0a03e4997a2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5" status: 200 len: 1364 microversion: 2.1 time: 0.194208 Jul 13 02:31:52.366714 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 369/730] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:31:52 2021] GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5 => generated 1364 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:31:52.608168 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-09045d8a-277d-4f09-b246-f0c594f8fe3d tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:52.608776 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-09045d8a-277d-4f09-b246-f0c594f8fe3d tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:52.615101 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-09045d8a-277d-4f09-b246-f0c594f8fe3d tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:52.615544 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-09045d8a-277d-4f09-b246-f0c594f8fe3d tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:52.616297 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-09045d8a-277d-4f09-b246-f0c594f8fe3d tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:52.616726 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-09045d8a-277d-4f09-b246-f0c594f8fe3d tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:52.619565 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:52.619565 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:52.720839 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-09045d8a-277d-4f09-b246-f0c594f8fe3d tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:52.723427 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:52.723427 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:31:52.730107 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-09045d8a-277d-4f09-b246-f0c594f8fe3d tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1262 microversion: 2.1 time: 0.125584 Jul 13 02:31:52.730669 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 370/731] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:31:52 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1262 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:31:53.383042 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-890b8103-dd8d-465d-af59-57c663a07885 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:53.383630 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-890b8103-dd8d-465d-af59-57c663a07885 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:53.389623 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-890b8103-dd8d-465d-af59-57c663a07885 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:53.390090 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-890b8103-dd8d-465d-af59-57c663a07885 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:53.390845 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-890b8103-dd8d-465d-af59-57c663a07885 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:53.391277 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-890b8103-dd8d-465d-af59-57c663a07885 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:53.394702 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:53.394702 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:53.564974 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-890b8103-dd8d-465d-af59-57c663a07885 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:53.568369 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:53.568369 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:31:53.575159 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-890b8103-dd8d-465d-af59-57c663a07885 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5" status: 200 len: 1364 microversion: 2.1 time: 0.195810 Jul 13 02:31:53.575765 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 371/732] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:31:53 2021] GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5 => generated 1364 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:31:53.746696 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-6574118d-7c85-435a-b2e1-8b8148ea5ba4 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:53.747325 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-6574118d-7c85-435a-b2e1-8b8148ea5ba4 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:53.753087 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6574118d-7c85-435a-b2e1-8b8148ea5ba4 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:53.753567 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6574118d-7c85-435a-b2e1-8b8148ea5ba4 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:53.754359 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6574118d-7c85-435a-b2e1-8b8148ea5ba4 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:53.754791 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6574118d-7c85-435a-b2e1-8b8148ea5ba4 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:53.757599 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:53.757599 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:53.856151 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-6574118d-7c85-435a-b2e1-8b8148ea5ba4 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:53.858766 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:53.858766 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:31:53.867231 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-6574118d-7c85-435a-b2e1-8b8148ea5ba4 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1262 microversion: 2.1 time: 0.123802 Jul 13 02:31:53.869098 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 372/733] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:31:53 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1262 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:31:53.887481 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-a6edb07a-38d3-4ae0-bb25-486d4c18b01e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action" status: 200 len: 24909 microversion: 2.20 time: 2.704915 Jul 13 02:31:53.888438 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 362/734] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:31:51 2021] POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action => generated 24909 bytes in 2707 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 13 02:31:54.592710 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-fa7ffff2-0628-4765-93c3-4eae03a88048 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:54.593323 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-fa7ffff2-0628-4765-93c3-4eae03a88048 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:54.599664 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-fa7ffff2-0628-4765-93c3-4eae03a88048 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:54.600112 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-fa7ffff2-0628-4765-93c3-4eae03a88048 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:54.600880 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-fa7ffff2-0628-4765-93c3-4eae03a88048 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:54.601331 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-fa7ffff2-0628-4765-93c3-4eae03a88048 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:54.604355 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:54.604355 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:54.871230 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-fa7ffff2-0628-4765-93c3-4eae03a88048 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:54.873768 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:54.873768 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:31:54.881705 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-fa7ffff2-0628-4765-93c3-4eae03a88048 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5" status: 200 len: 1364 microversion: 2.1 time: 0.292962 Jul 13 02:31:54.882477 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 373/735] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:31:54 2021] GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5 => generated 1364 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:31:54.885463 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-9327bd07-ab50-42f3-b2a2-0e5f18fe89ab tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:54.886299 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-9327bd07-ab50-42f3-b2a2-0e5f18fe89ab tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:54.895819 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9327bd07-ab50-42f3-b2a2-0e5f18fe89ab tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:54.896405 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9327bd07-ab50-42f3-b2a2-0e5f18fe89ab tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:54.897035 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9327bd07-ab50-42f3-b2a2-0e5f18fe89ab tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:54.897464 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9327bd07-ab50-42f3-b2a2-0e5f18fe89ab tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:54.900431 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-9440c65d-8697-4277-8cb8-2ef1f63b6bc0 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:31:54.900565 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:54.900565 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:54.901607 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-9440c65d-8697-4277-8cb8-2ef1f63b6bc0 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:54.908067 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-9440c65d-8697-4277-8cb8-2ef1f63b6bc0 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:54.908647 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-9440c65d-8697-4277-8cb8-2ef1f63b6bc0 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:54.910334 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-9440c65d-8697-4277-8cb8-2ef1f63b6bc0 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:54.910955 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-9440c65d-8697-4277-8cb8-2ef1f63b6bc0 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:54.914572 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:54.914572 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:55.047542 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-9440c65d-8697-4277-8cb8-2ef1f63b6bc0 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action" status: 200 len: 26376 microversion: 2.20 time: 0.151259 Jul 13 02:31:55.048201 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 374/736] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:31:54 2021] POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action => generated 26376 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:31:55.255689 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-9327bd07-ab50-42f3-b2a2-0e5f18fe89ab tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:55.258442 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:55.258442 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:31:55.266322 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-9327bd07-ab50-42f3-b2a2-0e5f18fe89ab tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1316 microversion: 2.1 time: 0.385279 Jul 13 02:31:55.267466 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 363/737] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:31:54 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1316 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:31:55.901256 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-329b63a4-f8dd-4400-b8f2-09e8e9cab415 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:55.902584 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-329b63a4-f8dd-4400-b8f2-09e8e9cab415 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:55.911548 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-329b63a4-f8dd-4400-b8f2-09e8e9cab415 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:55.912244 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-329b63a4-f8dd-4400-b8f2-09e8e9cab415 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:55.913237 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-329b63a4-f8dd-4400-b8f2-09e8e9cab415 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:55.913884 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-329b63a4-f8dd-4400-b8f2-09e8e9cab415 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:55.917125 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:55.917125 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:56.060352 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-c98b46e9-2c14-41f7-92fe-aaadcca24621 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:31:56.062364 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-c98b46e9-2c14-41f7-92fe-aaadcca24621 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:56.070825 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c98b46e9-2c14-41f7-92fe-aaadcca24621 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:56.071599 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c98b46e9-2c14-41f7-92fe-aaadcca24621 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:56.072696 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c98b46e9-2c14-41f7-92fe-aaadcca24621 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:56.073337 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c98b46e9-2c14-41f7-92fe-aaadcca24621 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:56.077515 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:56.077515 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:56.131608 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-329b63a4-f8dd-4400-b8f2-09e8e9cab415 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:56.134228 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:56.134228 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:31:56.151302 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-329b63a4-f8dd-4400-b8f2-09e8e9cab415 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5" status: 200 len: 1364 microversion: 2.1 time: 0.254826 Jul 13 02:31:56.151819 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 375/738] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:31:55 2021] GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5 => generated 1364 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:31:56.156200 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [req-5dd1f1f8-69ec-4a49-9257-cf25e927ca2c req-6e2525c3-9b9c-4330-b727-a8effb282610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "358bc320-a9f0-47c9-aae8-72c8c45102f5", "name": "network-vif-plugged", "status": "completed", "tag": "2f2dc5f8-6784-45e5-8b42-42c216edcb56"}]} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:31:56.157668 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:31:56.157668 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: warnings.warn(msg) Jul 13 02:31:56.169296 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-5dd1f1f8-69ec-4a49-9257-cf25e927ca2c req-6e2525c3-9b9c-4330-b727-a8effb282610 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:56.170117 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-5dd1f1f8-69ec-4a49-9257-cf25e927ca2c req-6e2525c3-9b9c-4330-b727-a8effb282610 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:56.188643 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.compute.server_external_events [req-5dd1f1f8-69ec-4a49-9257-cf25e927ca2c req-6e2525c3-9b9c-4330-b727-a8effb282610 service nova] Creating event network-vif-plugged:2f2dc5f8-6784-45e5-8b42-42c216edcb56 for instance 358bc320-a9f0-47c9-aae8-72c8c45102f5 on hv-cinder-78102 Jul 13 02:31:56.197111 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [req-5dd1f1f8-69ec-4a49-9257-cf25e927ca2c req-6e2525c3-9b9c-4330-b727-a8effb282610 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043500 Jul 13 02:31:56.198889 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 376/739] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:31:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:31:56.284048 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-a9658d06-5a2f-47c8-9944-0bf3e0472d6f tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:56.285160 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-a9658d06-5a2f-47c8-9944-0bf3e0472d6f tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:56.297906 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a9658d06-5a2f-47c8-9944-0bf3e0472d6f tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:56.298825 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a9658d06-5a2f-47c8-9944-0bf3e0472d6f tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:56.299985 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a9658d06-5a2f-47c8-9944-0bf3e0472d6f tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:56.301195 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a9658d06-5a2f-47c8-9944-0bf3e0472d6f tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:56.305645 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:56.305645 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:56.591135 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-a9658d06-5a2f-47c8-9944-0bf3e0472d6f tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:56.593677 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:56.593677 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:31:56.601864 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-a9658d06-5a2f-47c8-9944-0bf3e0472d6f tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1358 microversion: 2.1 time: 0.321689 Jul 13 02:31:56.602467 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 377/740] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:31:56 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1358 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:31:57.167590 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-9e63e7de-047c-4737-80b0-4201a6e61220 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:57.168297 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-9e63e7de-047c-4737-80b0-4201a6e61220 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:57.174402 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-9e63e7de-047c-4737-80b0-4201a6e61220 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:57.174856 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-9e63e7de-047c-4737-80b0-4201a6e61220 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:57.175649 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-9e63e7de-047c-4737-80b0-4201a6e61220 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:57.176158 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-9e63e7de-047c-4737-80b0-4201a6e61220 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:57.179168 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:57.179168 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:57.356980 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-9e63e7de-047c-4737-80b0-4201a6e61220 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:57.359754 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:57.359754 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:31:57.368237 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-9e63e7de-047c-4737-80b0-4201a6e61220 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5" status: 200 len: 1364 microversion: 2.1 time: 0.204190 Jul 13 02:31:57.369021 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 378/741] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:31:57 2021] GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5 => generated 1364 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:31:57.619719 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-cafd7ff3-fef9-41fc-9619-774294e96a79 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:57.620327 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-cafd7ff3-fef9-41fc-9619-774294e96a79 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:57.626527 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-cafd7ff3-fef9-41fc-9619-774294e96a79 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:57.627150 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-cafd7ff3-fef9-41fc-9619-774294e96a79 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:57.628041 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-cafd7ff3-fef9-41fc-9619-774294e96a79 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:57.628879 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-cafd7ff3-fef9-41fc-9619-774294e96a79 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:57.632360 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:57.632360 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:58.080823 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-cafd7ff3-fef9-41fc-9619-774294e96a79 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:58.083974 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:58.083974 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:31:58.091207 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-cafd7ff3-fef9-41fc-9619-774294e96a79 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1358 microversion: 2.1 time: 0.474952 Jul 13 02:31:58.091932 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 379/742] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:31:57 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1358 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:31:58.385559 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-86a21185-50e0-42cc-b93c-90ff2dd8b28b tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:58.386246 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-86a21185-50e0-42cc-b93c-90ff2dd8b28b tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:58.392218 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-86a21185-50e0-42cc-b93c-90ff2dd8b28b tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:58.392906 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-86a21185-50e0-42cc-b93c-90ff2dd8b28b tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:58.393673 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-86a21185-50e0-42cc-b93c-90ff2dd8b28b tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:58.394716 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-86a21185-50e0-42cc-b93c-90ff2dd8b28b tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:58.398367 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:58.398367 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:58.582963 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-86a21185-50e0-42cc-b93c-90ff2dd8b28b tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:58.585591 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:58.585591 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:31:58.593074 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-86a21185-50e0-42cc-b93c-90ff2dd8b28b tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5" status: 200 len: 1364 microversion: 2.1 time: 0.211297 Jul 13 02:31:58.593662 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 380/743] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:31:58 2021] GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5 => generated 1364 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:31:59.110521 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-f784931d-1d1f-4083-a185-b84b2ba1b320 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:59.116516 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-f784931d-1d1f-4083-a185-b84b2ba1b320 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:59.123203 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f784931d-1d1f-4083-a185-b84b2ba1b320 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:59.123680 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f784931d-1d1f-4083-a185-b84b2ba1b320 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:59.124472 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f784931d-1d1f-4083-a185-b84b2ba1b320 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:59.124909 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f784931d-1d1f-4083-a185-b84b2ba1b320 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:59.129814 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:59.129814 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:59.340124 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-f784931d-1d1f-4083-a185-b84b2ba1b320 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:59.343291 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:59.343291 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:31:59.351983 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-f784931d-1d1f-4083-a185-b84b2ba1b320 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1358 microversion: 2.1 time: 0.246501 Jul 13 02:31:59.353169 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 381/744] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:31:59 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1358 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:31:59.610424 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-3e7b2a81-9c66-4e09-a6f0-c48a1e42212a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:31:59.611240 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-3e7b2a81-9c66-4e09-a6f0-c48a1e42212a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:31:59.617177 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-3e7b2a81-9c66-4e09-a6f0-c48a1e42212a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:59.617630 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-3e7b2a81-9c66-4e09-a6f0-c48a1e42212a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:59.618432 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-3e7b2a81-9c66-4e09-a6f0-c48a1e42212a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:31:59.618866 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-3e7b2a81-9c66-4e09-a6f0-c48a1e42212a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:31:59.621854 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:59.621854 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:31:59.803227 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-3e7b2a81-9c66-4e09-a6f0-c48a1e42212a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:31:59.805841 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:31:59.805841 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:31:59.816842 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-3e7b2a81-9c66-4e09-a6f0-c48a1e42212a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5" status: 200 len: 1364 microversion: 2.1 time: 0.210086 Jul 13 02:31:59.817611 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 382/745] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:31:59 2021] GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5 => generated 1364 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:32:00.369586 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-f424a84a-b29a-4c5d-a807-f4efee1b702c tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:00.370340 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-f424a84a-b29a-4c5d-a807-f4efee1b702c tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:00.377343 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f424a84a-b29a-4c5d-a807-f4efee1b702c tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:00.377818 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f424a84a-b29a-4c5d-a807-f4efee1b702c tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:00.379526 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f424a84a-b29a-4c5d-a807-f4efee1b702c tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:00.380030 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f424a84a-b29a-4c5d-a807-f4efee1b702c tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:00.383602 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:00.383602 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:00.678042 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-f424a84a-b29a-4c5d-a807-f4efee1b702c tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:00.681977 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:00.681977 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:00.689732 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-f424a84a-b29a-4c5d-a807-f4efee1b702c tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1358 microversion: 2.1 time: 0.323818 Jul 13 02:32:00.690431 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 383/746] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:32:00 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1358 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:32:00.834070 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-f8da9e98-c7a4-459f-a4eb-ca8e5339e9ba tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:00.834676 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-f8da9e98-c7a4-459f-a4eb-ca8e5339e9ba tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:00.840579 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f8da9e98-c7a4-459f-a4eb-ca8e5339e9ba tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:00.841023 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f8da9e98-c7a4-459f-a4eb-ca8e5339e9ba tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:00.842095 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f8da9e98-c7a4-459f-a4eb-ca8e5339e9ba tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:00.842683 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f8da9e98-c7a4-459f-a4eb-ca8e5339e9ba tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:00.845908 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:00.845908 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:01.059269 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-f8da9e98-c7a4-459f-a4eb-ca8e5339e9ba tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:01.061829 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:01.061829 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:01.069358 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-f8da9e98-c7a4-459f-a4eb-ca8e5339e9ba tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5" status: 200 len: 1364 microversion: 2.1 time: 0.239097 Jul 13 02:32:01.069948 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 384/747] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:32:00 2021] GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5 => generated 1364 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:32:01.710736 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-c7a7a672-d520-4bbc-b48f-4836a2fe08d0 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:01.711536 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-c7a7a672-d520-4bbc-b48f-4836a2fe08d0 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:01.734895 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c7a7a672-d520-4bbc-b48f-4836a2fe08d0 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:01.736779 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c7a7a672-d520-4bbc-b48f-4836a2fe08d0 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:01.738968 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c7a7a672-d520-4bbc-b48f-4836a2fe08d0 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:01.741477 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c7a7a672-d520-4bbc-b48f-4836a2fe08d0 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:01.750965 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:01.750965 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:02.025159 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-c7a7a672-d520-4bbc-b48f-4836a2fe08d0 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:02.028399 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:02.028399 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:02.036760 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-c7a7a672-d520-4bbc-b48f-4836a2fe08d0 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1358 microversion: 2.1 time: 0.334087 Jul 13 02:32:02.042633 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 385/748] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:32:01 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1358 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:32:02.087321 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-062fb285-491e-4e03-abe5-822c742f8680 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:02.088204 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-062fb285-491e-4e03-abe5-822c742f8680 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:02.094899 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-062fb285-491e-4e03-abe5-822c742f8680 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:02.095349 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-062fb285-491e-4e03-abe5-822c742f8680 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:02.096134 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-062fb285-491e-4e03-abe5-822c742f8680 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:02.096628 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-062fb285-491e-4e03-abe5-822c742f8680 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:02.100796 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:02.100796 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:02.491065 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-062fb285-491e-4e03-abe5-822c742f8680 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:02.496056 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:02.496056 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:02.511715 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-062fb285-491e-4e03-abe5-822c742f8680 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5" status: 200 len: 1364 microversion: 2.1 time: 0.427851 Jul 13 02:32:02.513397 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 386/749] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:32:02 2021] GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5 => generated 1364 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:32:03.060250 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-8584aa38-b301-49a8-8fb4-44fc5943db54 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:03.064027 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-8584aa38-b301-49a8-8fb4-44fc5943db54 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:03.075015 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8584aa38-b301-49a8-8fb4-44fc5943db54 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:03.077830 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8584aa38-b301-49a8-8fb4-44fc5943db54 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:03.079479 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8584aa38-b301-49a8-8fb4-44fc5943db54 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:03.079479 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8584aa38-b301-49a8-8fb4-44fc5943db54 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:03.091770 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:03.091770 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:03.546046 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-8584aa38-b301-49a8-8fb4-44fc5943db54 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:03.549463 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:03.549463 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:03.564573 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-8584aa38-b301-49a8-8fb4-44fc5943db54 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1358 microversion: 2.1 time: 0.510210 Jul 13 02:32:03.565261 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 387/750] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:32:03 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1358 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:32:03.570765 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-39eda027-efd6-44ee-8a1f-78d4ee2d599a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:03.571424 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-39eda027-efd6-44ee-8a1f-78d4ee2d599a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:03.579310 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-39eda027-efd6-44ee-8a1f-78d4ee2d599a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:03.579720 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-39eda027-efd6-44ee-8a1f-78d4ee2d599a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:03.580506 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-39eda027-efd6-44ee-8a1f-78d4ee2d599a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:03.580963 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-39eda027-efd6-44ee-8a1f-78d4ee2d599a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:03.585581 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:03.585581 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:03.958671 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-39eda027-efd6-44ee-8a1f-78d4ee2d599a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:03.961364 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:03.961364 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:03.978853 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-39eda027-efd6-44ee-8a1f-78d4ee2d599a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5" status: 200 len: 1364 microversion: 2.1 time: 0.412391 Jul 13 02:32:03.979792 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 388/751] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:32:03 2021] GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5 => generated 1364 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:32:04.583254 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-e453f741-bd4c-4cd0-8585-b60dd4330a8f tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:04.583994 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-e453f741-bd4c-4cd0-8585-b60dd4330a8f tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:04.589752 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e453f741-bd4c-4cd0-8585-b60dd4330a8f tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:04.590531 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e453f741-bd4c-4cd0-8585-b60dd4330a8f tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:04.591317 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e453f741-bd4c-4cd0-8585-b60dd4330a8f tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:04.591925 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e453f741-bd4c-4cd0-8585-b60dd4330a8f tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:04.606428 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:04.606428 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:04.814358 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-e453f741-bd4c-4cd0-8585-b60dd4330a8f tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:04.817595 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:04.817595 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:04.826095 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-e453f741-bd4c-4cd0-8585-b60dd4330a8f tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1358 microversion: 2.1 time: 0.247149 Jul 13 02:32:04.826722 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 389/752] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:32:04 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1358 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:32:04.997007 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-06183c4d-f51c-4ab0-9bf6-f0bbcf246ec0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:04.997629 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-06183c4d-f51c-4ab0-9bf6-f0bbcf246ec0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:05.004147 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-06183c4d-f51c-4ab0-9bf6-f0bbcf246ec0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:05.004626 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-06183c4d-f51c-4ab0-9bf6-f0bbcf246ec0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:05.005404 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-06183c4d-f51c-4ab0-9bf6-f0bbcf246ec0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:05.005836 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-06183c4d-f51c-4ab0-9bf6-f0bbcf246ec0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:05.008982 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:05.008982 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:05.206437 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-06183c4d-f51c-4ab0-9bf6-f0bbcf246ec0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:05.209247 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:05.209247 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:05.218624 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-06183c4d-f51c-4ab0-9bf6-f0bbcf246ec0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5" status: 200 len: 1364 microversion: 2.1 time: 0.225701 Jul 13 02:32:05.219405 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 390/753] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:32:04 2021] GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5 => generated 1364 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:32:05.440058 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-c98b46e9-2c14-41f7-92fe-aaadcca24621 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action" status: 200 len: 28829 microversion: 2.20 time: 9.382685 Jul 13 02:32:05.447381 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 364/754] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:31:56 2021] POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action => generated 28829 bytes in 9391 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:32:05.852579 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-ff12f14a-b571-40d4-9d57-51308e3c5971 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:05.854649 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-ff12f14a-b571-40d4-9d57-51308e3c5971 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:05.864324 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ff12f14a-b571-40d4-9d57-51308e3c5971 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:05.865552 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ff12f14a-b571-40d4-9d57-51308e3c5971 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:05.866704 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ff12f14a-b571-40d4-9d57-51308e3c5971 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:05.867137 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ff12f14a-b571-40d4-9d57-51308e3c5971 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:05.870821 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:05.870821 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:06.301181 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-ff12f14a-b571-40d4-9d57-51308e3c5971 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:06.304047 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:06.304047 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:06.315061 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-ff12f14a-b571-40d4-9d57-51308e3c5971 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1358 microversion: 2.1 time: 0.468497 Jul 13 02:32:06.328983 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 391/755] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:32:05 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1358 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:32:06.392621 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [req-6f12f8cb-8902-4fb0-8674-7aa1eed689ea req-1f353e6f-dab2-49e7-8fb2-1ff457285000 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "578a1bf5-b64e-45c5-ac82-32809189a525", "tag": "bc4abdbb-fe6a-4872-b0b8-aca5ec258475"}]} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:06.394366 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:32:06.394366 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: warnings.warn(msg) Jul 13 02:32:06.418322 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-6f12f8cb-8902-4fb0-8674-7aa1eed689ea req-1f353e6f-dab2-49e7-8fb2-1ff457285000 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:06.421347 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-6f12f8cb-8902-4fb0-8674-7aa1eed689ea req-1f353e6f-dab2-49e7-8fb2-1ff457285000 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:06.446979 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.compute.server_external_events [req-6f12f8cb-8902-4fb0-8674-7aa1eed689ea req-1f353e6f-dab2-49e7-8fb2-1ff457285000 service nova] Creating event network-changed:bc4abdbb-fe6a-4872-b0b8-aca5ec258475 for instance 578a1bf5-b64e-45c5-ac82-32809189a525 on hv-cinder-78102 Jul 13 02:32:06.457663 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [req-6f12f8cb-8902-4fb0-8674-7aa1eed689ea req-1f353e6f-dab2-49e7-8fb2-1ff457285000 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069324 Jul 13 02:32:06.458299 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 392/756] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:32:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:32:06.470426 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-501d3269-eda6-4d3d-bfb8-e95beb750ea7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:06.484627 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-501d3269-eda6-4d3d-bfb8-e95beb750ea7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:06.507414 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-1903c20b-796e-4979-bcf3-98cc4c2a996b tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:06.508067 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-501d3269-eda6-4d3d-bfb8-e95beb750ea7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:06.508186 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-1903c20b-796e-4979-bcf3-98cc4c2a996b tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:06.508315 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-501d3269-eda6-4d3d-bfb8-e95beb750ea7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:06.509414 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-501d3269-eda6-4d3d-bfb8-e95beb750ea7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:06.510129 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-501d3269-eda6-4d3d-bfb8-e95beb750ea7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:06.514263 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:06.514263 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:06.516140 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1903c20b-796e-4979-bcf3-98cc4c2a996b tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:06.516621 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1903c20b-796e-4979-bcf3-98cc4c2a996b tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:06.517407 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1903c20b-796e-4979-bcf3-98cc4c2a996b tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:06.517864 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1903c20b-796e-4979-bcf3-98cc4c2a996b tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:06.525115 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:06.525115 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:06.747093 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-501d3269-eda6-4d3d-bfb8-e95beb750ea7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action" status: 200 len: 30807 microversion: 2.20 time: 0.282840 Jul 13 02:32:06.747898 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 393/757] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:32:06 2021] POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action => generated 30807 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:32:06.914790 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-1903c20b-796e-4979-bcf3-98cc4c2a996b tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:06.917981 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:06.917981 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:06.927085 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-1903c20b-796e-4979-bcf3-98cc4c2a996b tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5" status: 200 len: 1364 microversion: 2.1 time: 0.687658 Jul 13 02:32:06.927974 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 365/758] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:32:06 2021] GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5 => generated 1364 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:32:07.339161 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-2b52b817-94eb-4cda-b04c-a5b2f0497222 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:07.344820 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-2b52b817-94eb-4cda-b04c-a5b2f0497222 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:07.359363 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2b52b817-94eb-4cda-b04c-a5b2f0497222 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:07.367084 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2b52b817-94eb-4cda-b04c-a5b2f0497222 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:07.368236 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2b52b817-94eb-4cda-b04c-a5b2f0497222 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:07.368784 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2b52b817-94eb-4cda-b04c-a5b2f0497222 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:07.375060 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:07.375060 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:07.760250 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-a23fe8ec-8195-4932-a8b2-44d9fbbd24eb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:07.762612 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-a23fe8ec-8195-4932-a8b2-44d9fbbd24eb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:07.771742 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a23fe8ec-8195-4932-a8b2-44d9fbbd24eb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:07.772790 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a23fe8ec-8195-4932-a8b2-44d9fbbd24eb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:07.773877 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a23fe8ec-8195-4932-a8b2-44d9fbbd24eb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:07.774715 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a23fe8ec-8195-4932-a8b2-44d9fbbd24eb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:07.778332 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:07.778332 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:07.953843 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-a23fe8ec-8195-4932-a8b2-44d9fbbd24eb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action" status: 200 len: 32434 microversion: 2.20 time: 0.197519 Jul 13 02:32:07.954534 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 366/759] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:32:07 2021] POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action => generated 32434 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 13 02:32:07.963281 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-94dd7a79-23ab-4943-9c39-58fba42d42f8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:07.964042 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-94dd7a79-23ab-4943-9c39-58fba42d42f8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:07.970887 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-94dd7a79-23ab-4943-9c39-58fba42d42f8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:07.971336 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-94dd7a79-23ab-4943-9c39-58fba42d42f8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:07.973656 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-94dd7a79-23ab-4943-9c39-58fba42d42f8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:07.974336 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-94dd7a79-23ab-4943-9c39-58fba42d42f8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:07.978718 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:07.978718 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:08.222647 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-2b52b817-94eb-4cda-b04c-a5b2f0497222 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:08.225334 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:08.225334 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:08.232247 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-2b52b817-94eb-4cda-b04c-a5b2f0497222 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1358 microversion: 2.1 time: 0.898307 Jul 13 02:32:08.232900 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 394/760] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:32:07 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1358 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:32:08.432190 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-94dd7a79-23ab-4943-9c39-58fba42d42f8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:08.435101 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:08.435101 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:08.443896 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-94dd7a79-23ab-4943-9c39-58fba42d42f8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5" status: 200 len: 1550 microversion: 2.1 time: 0.487772 Jul 13 02:32:08.444566 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 367/761] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:32:07 2021] GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5 => generated 1550 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:32:08.461806 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-87e558b8-be6b-4848-ae7f-f0e4a64611a2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:08.463060 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-87e558b8-be6b-4848-ae7f-f0e4a64611a2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:08.470011 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-87e558b8-be6b-4848-ae7f-f0e4a64611a2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:08.470737 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-87e558b8-be6b-4848-ae7f-f0e4a64611a2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:08.472249 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-87e558b8-be6b-4848-ae7f-f0e4a64611a2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:08.472975 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-87e558b8-be6b-4848-ae7f-f0e4a64611a2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:08.476227 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:08.476227 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:08.710661 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-87e558b8-be6b-4848-ae7f-f0e4a64611a2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.250443 Jul 13 02:32:08.712576 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 395/762] 10.222.0.32 () {58 vars in 1275 bytes} [Tue Jul 13 02:32:08 2021] GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/os-interface => generated 284 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:32:08.966441 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-6415f089-45f5-4b2b-bdd1-c8009e6e61e0 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:08.967988 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-6415f089-45f5-4b2b-bdd1-c8009e6e61e0 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:08.976275 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-6415f089-45f5-4b2b-bdd1-c8009e6e61e0 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:08.976894 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-6415f089-45f5-4b2b-bdd1-c8009e6e61e0 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:08.978187 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-6415f089-45f5-4b2b-bdd1-c8009e6e61e0 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:08.978780 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-6415f089-45f5-4b2b-bdd1-c8009e6e61e0 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:08.982672 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:08.982672 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:09.120888 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-6415f089-45f5-4b2b-bdd1-c8009e6e61e0 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action" status: 200 len: 33622 microversion: 2.20 time: 0.158003 Jul 13 02:32:09.122441 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 368/763] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:32:08 2021] POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action => generated 33622 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:32:09.258367 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-57cf523e-5ca9-49b8-b8e2-4e88b830046c tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:09.259727 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-57cf523e-5ca9-49b8-b8e2-4e88b830046c tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:09.269669 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-57cf523e-5ca9-49b8-b8e2-4e88b830046c tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:09.270636 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-57cf523e-5ca9-49b8-b8e2-4e88b830046c tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:09.272389 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-57cf523e-5ca9-49b8-b8e2-4e88b830046c tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:09.273110 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-57cf523e-5ca9-49b8-b8e2-4e88b830046c tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:09.276757 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:09.276757 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:09.511882 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-57cf523e-5ca9-49b8-b8e2-4e88b830046c tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:09.515341 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:09.515341 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:09.523720 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-57cf523e-5ca9-49b8-b8e2-4e88b830046c tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1358 microversion: 2.1 time: 0.276860 Jul 13 02:32:09.533634 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 396/764] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:32:09 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1358 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:32:10.135344 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-a5b033e5-678b-4e1d-ac84-b6b9390eb0e2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:10.137015 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-a5b033e5-678b-4e1d-ac84-b6b9390eb0e2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:10.149597 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a5b033e5-678b-4e1d-ac84-b6b9390eb0e2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:10.150054 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a5b033e5-678b-4e1d-ac84-b6b9390eb0e2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:10.154767 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a5b033e5-678b-4e1d-ac84-b6b9390eb0e2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:10.156259 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a5b033e5-678b-4e1d-ac84-b6b9390eb0e2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:10.161797 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:10.161797 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:10.313864 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-a5b033e5-678b-4e1d-ac84-b6b9390eb0e2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action" status: 200 len: 34916 microversion: 2.20 time: 0.183491 Jul 13 02:32:10.314571 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 369/765] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:32:10 2021] POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action => generated 34916 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 13 02:32:10.540647 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-b906ef74-927b-48b3-9891-624d3dbaec46 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:10.541973 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-b906ef74-927b-48b3-9891-624d3dbaec46 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:10.557879 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b906ef74-927b-48b3-9891-624d3dbaec46 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:10.558617 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b906ef74-927b-48b3-9891-624d3dbaec46 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:10.559812 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b906ef74-927b-48b3-9891-624d3dbaec46 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:10.560509 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b906ef74-927b-48b3-9891-624d3dbaec46 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:10.564822 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:10.564822 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:10.860375 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-62d86b50-ab55-42bd-baa6-eb8e65502de9 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:10.861418 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-62d86b50-ab55-42bd-baa6-eb8e65502de9 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:10.876937 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-62d86b50-ab55-42bd-baa6-eb8e65502de9 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:10.877821 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-62d86b50-ab55-42bd-baa6-eb8e65502de9 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:10.878957 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-62d86b50-ab55-42bd-baa6-eb8e65502de9 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:10.879621 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-62d86b50-ab55-42bd-baa6-eb8e65502de9 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:10.885514 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-b906ef74-927b-48b3-9891-624d3dbaec46 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:10.888604 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:10.888604 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:10.888828 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:10.888828 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:10.907037 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-b906ef74-927b-48b3-9891-624d3dbaec46 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1358 microversion: 2.1 time: 0.369874 Jul 13 02:32:10.907623 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 397/766] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:32:10 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1358 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:32:10.998762 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [req-ff522c3c-4e9d-4f7c-adfb-08f4140a6aac req-07dba938-c6be-4c3c-abef-5cfa56db4c41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "358bc320-a9f0-47c9-aae8-72c8c45102f5", "tag": "2f2dc5f8-6784-45e5-8b42-42c216edcb56"}]} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:11.000142 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:32:11.000142 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: warnings.warn(msg) Jul 13 02:32:11.011997 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-ff522c3c-4e9d-4f7c-adfb-08f4140a6aac req-07dba938-c6be-4c3c-abef-5cfa56db4c41 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:11.012660 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-ff522c3c-4e9d-4f7c-adfb-08f4140a6aac req-07dba938-c6be-4c3c-abef-5cfa56db4c41 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:11.027108 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.compute.server_external_events [req-ff522c3c-4e9d-4f7c-adfb-08f4140a6aac req-07dba938-c6be-4c3c-abef-5cfa56db4c41 service nova] Creating event network-changed:2f2dc5f8-6784-45e5-8b42-42c216edcb56 for instance 358bc320-a9f0-47c9-aae8-72c8c45102f5 on hv-cinder-78102 Jul 13 02:32:11.038108 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [req-ff522c3c-4e9d-4f7c-adfb-08f4140a6aac req-07dba938-c6be-4c3c-abef-5cfa56db4c41 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042851 Jul 13 02:32:11.038978 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 398/767] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:32:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 02:32:11.046621 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-62d86b50-ab55-42bd-baa6-eb8e65502de9 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action" status: 200 len: 14 microversion: 2.1 time: 0.190132 Jul 13 02:32:11.050803 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 370/768] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:32:10 2021] POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action => generated 14 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 13 02:32:11.336364 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-f3912b69-3617-48bb-bb35-b9562a94176d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:11.338738 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-f3912b69-3617-48bb-bb35-b9562a94176d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:11.355634 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f3912b69-3617-48bb-bb35-b9562a94176d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:11.356343 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f3912b69-3617-48bb-bb35-b9562a94176d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:11.357354 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f3912b69-3617-48bb-bb35-b9562a94176d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:11.357997 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f3912b69-3617-48bb-bb35-b9562a94176d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:11.361908 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:11.361908 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:11.551879 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-f3912b69-3617-48bb-bb35-b9562a94176d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action" status: 200 len: 36154 microversion: 2.20 time: 0.227164 Jul 13 02:32:11.552975 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 399/769] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:32:11 2021] POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action => generated 36154 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:32:11.926462 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-7a6d8767-75ff-46aa-8bbc-5af89443538b tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:11.927751 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-7a6d8767-75ff-46aa-8bbc-5af89443538b tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:11.936571 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7a6d8767-75ff-46aa-8bbc-5af89443538b tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:11.937105 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7a6d8767-75ff-46aa-8bbc-5af89443538b tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:11.937948 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7a6d8767-75ff-46aa-8bbc-5af89443538b tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:11.938467 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7a6d8767-75ff-46aa-8bbc-5af89443538b tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:11.943017 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:11.943017 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:12.059758 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-0d6978f0-af1d-45be-bd00-5b6f1e371111 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:12.060957 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-0d6978f0-af1d-45be-bd00-5b6f1e371111 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:12.068331 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0d6978f0-af1d-45be-bd00-5b6f1e371111 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:12.069052 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0d6978f0-af1d-45be-bd00-5b6f1e371111 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:12.069992 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0d6978f0-af1d-45be-bd00-5b6f1e371111 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:12.070744 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0d6978f0-af1d-45be-bd00-5b6f1e371111 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:12.073924 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:12.073924 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:12.199659 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-0d6978f0-af1d-45be-bd00-5b6f1e371111 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action" status: 200 len: 14 microversion: 2.1 time: 0.144067 Jul 13 02:32:12.204320 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 400/770] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:32:12 2021] POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action => generated 14 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 13 02:32:12.389475 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-7a6d8767-75ff-46aa-8bbc-5af89443538b tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:12.392116 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:12.392116 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:12.403788 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-7a6d8767-75ff-46aa-8bbc-5af89443538b tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1358 microversion: 2.1 time: 0.482603 Jul 13 02:32:12.404736 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 371/771] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:32:11 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1358 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:32:12.564451 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-482ae64d-b6d5-4209-b4d3-d3606af1aef2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:12.566341 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-482ae64d-b6d5-4209-b4d3-d3606af1aef2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:12.573764 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-482ae64d-b6d5-4209-b4d3-d3606af1aef2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:12.574401 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-482ae64d-b6d5-4209-b4d3-d3606af1aef2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:12.575407 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-482ae64d-b6d5-4209-b4d3-d3606af1aef2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:12.576125 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-482ae64d-b6d5-4209-b4d3-d3606af1aef2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:12.579626 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:12.579626 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:12.633247 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-1f4f8b6d-40b8-401c-a0fd-7e1d86fea47b req-c75efb29-655c-467e-a2e0-1185678e8d57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "578a1bf5-b64e-45c5-ac82-32809189a525", "name": "network-vif-plugged", "status": "completed", "tag": "bc4abdbb-fe6a-4872-b0b8-aca5ec258475"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:12.635102 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:32:12.635102 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:32:12.650999 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-1f4f8b6d-40b8-401c-a0fd-7e1d86fea47b req-c75efb29-655c-467e-a2e0-1185678e8d57 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:12.651633 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-1f4f8b6d-40b8-401c-a0fd-7e1d86fea47b req-c75efb29-655c-467e-a2e0-1185678e8d57 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:12.678700 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-1f4f8b6d-40b8-401c-a0fd-7e1d86fea47b req-c75efb29-655c-467e-a2e0-1185678e8d57 service nova] Creating event network-vif-plugged:bc4abdbb-fe6a-4872-b0b8-aca5ec258475 for instance 578a1bf5-b64e-45c5-ac82-32809189a525 on hv-cinder-78102 Jul 13 02:32:12.691065 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-1f4f8b6d-40b8-401c-a0fd-7e1d86fea47b req-c75efb29-655c-467e-a2e0-1185678e8d57 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061292 Jul 13 02:32:12.693720 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 372/772] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:32:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 02:32:12.777771 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-482ae64d-b6d5-4209-b4d3-d3606af1aef2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action" status: 200 len: 38018 microversion: 2.20 time: 0.217391 Jul 13 02:32:12.779375 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 401/773] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:32:12 2021] POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action => generated 38018 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 13 02:32:13.216092 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-f16bcb28-0ad2-41fc-a1e0-e00b71e2de5d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:13.217432 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-f16bcb28-0ad2-41fc-a1e0-e00b71e2de5d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:13.232671 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f16bcb28-0ad2-41fc-a1e0-e00b71e2de5d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:13.246188 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f16bcb28-0ad2-41fc-a1e0-e00b71e2de5d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:13.247420 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f16bcb28-0ad2-41fc-a1e0-e00b71e2de5d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:13.249073 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f16bcb28-0ad2-41fc-a1e0-e00b71e2de5d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:13.255970 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:13.255970 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:13.420976 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-6a799c58-0b8b-4e5c-8fff-b3459b7d6c40 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:13.423143 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-6a799c58-0b8b-4e5c-8fff-b3459b7d6c40 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:13.443070 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6a799c58-0b8b-4e5c-8fff-b3459b7d6c40 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:13.443508 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6a799c58-0b8b-4e5c-8fff-b3459b7d6c40 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:13.444345 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6a799c58-0b8b-4e5c-8fff-b3459b7d6c40 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:13.444786 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6a799c58-0b8b-4e5c-8fff-b3459b7d6c40 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:13.454289 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:13.454289 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:13.490536 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-f16bcb28-0ad2-41fc-a1e0-e00b71e2de5d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action" status: 200 len: 14 microversion: 2.1 time: 0.282247 Jul 13 02:32:13.491170 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 373/774] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:32:13 2021] POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action => generated 14 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 13 02:32:13.823285 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-6a799c58-0b8b-4e5c-8fff-b3459b7d6c40 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:13.828140 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:13.828140 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:13.839658 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-6a799c58-0b8b-4e5c-8fff-b3459b7d6c40 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1358 microversion: 2.1 time: 0.420713 Jul 13 02:32:13.841320 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 402/775] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:32:13 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1358 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:32:14.112897 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-ded240b1-b0b9-4734-8779-32fccd9f1179 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:14.113892 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-ded240b1-b0b9-4734-8779-32fccd9f1179 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:14.121447 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ded240b1-b0b9-4734-8779-32fccd9f1179 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:14.121890 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ded240b1-b0b9-4734-8779-32fccd9f1179 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:14.123837 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ded240b1-b0b9-4734-8779-32fccd9f1179 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:14.124310 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ded240b1-b0b9-4734-8779-32fccd9f1179 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:14.127370 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:14.127370 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:14.266078 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-ded240b1-b0b9-4734-8779-32fccd9f1179 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action" status: 200 len: 38198 microversion: 2.20 time: 0.477741 Jul 13 02:32:14.268340 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 374/776] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:32:13 2021] POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action => generated 38198 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 13 02:32:14.501783 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-4be2668c-e087-4eb4-847f-54c7dca6acef tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:14.502936 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-4be2668c-e087-4eb4-847f-54c7dca6acef tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:14.509820 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4be2668c-e087-4eb4-847f-54c7dca6acef tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:14.511106 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4be2668c-e087-4eb4-847f-54c7dca6acef tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:14.513415 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4be2668c-e087-4eb4-847f-54c7dca6acef tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:14.514599 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4be2668c-e087-4eb4-847f-54c7dca6acef tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:14.520267 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:14.520267 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:14.666354 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-4be2668c-e087-4eb4-847f-54c7dca6acef tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action" status: 200 len: 14 microversion: 2.1 time: 0.168677 Jul 13 02:32:14.666916 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 403/777] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:32:14 2021] POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action => generated 14 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 13 02:32:14.695231 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-a3cb65ef-611f-4f4d-99b1-6c6f7ee4e390 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Action: 'create', calling method: .version_select at 0x7f43126bd5e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-96975266"}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:14.703386 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2656: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:14.703386 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return model_query(context, models.KeyPair, read_deleted="no").\ Jul 13 02:32:14.716728 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2708: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:14.716728 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: rows = model_query(context, models.Quota, read_deleted="no").\ Jul 13 02:32:14.720334 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.quota [None req-a3cb65ef-611f-4f4d-99b1-6c6f7ee4e390 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Getting quotas for project 345d0f5c3c2842e0940d216397b5cd51. Resources: {'key_pairs'} {{(pid=107262) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 13 02:32:14.724397 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.quota [None req-a3cb65ef-611f-4f4d-99b1-6c6f7ee4e390 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Getting quotas for user 2e23950a4bea4e70a2a8be2c2dd9743e and project 345d0f5c3c2842e0940d216397b5cd51. Resources: {'key_pairs'} {{(pid=107262) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 13 02:32:14.729612 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2690: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:14.729612 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: user_quotas = model_query(context, models.ProjectUserQuota, Jul 13 02:32:14.857380 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-2de2d276-cb91-411d-8ed9-ad7a80190a64 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:14.858276 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-2de2d276-cb91-411d-8ed9-ad7a80190a64 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:14.867414 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2de2d276-cb91-411d-8ed9-ad7a80190a64 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:14.867923 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2de2d276-cb91-411d-8ed9-ad7a80190a64 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:14.868862 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2de2d276-cb91-411d-8ed9-ad7a80190a64 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:14.869326 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2de2d276-cb91-411d-8ed9-ad7a80190a64 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:14.873065 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:14.873065 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:14.994654 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2621: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:14.994654 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = model_query(context, models.KeyPair).\ Jul 13 02:32:15.029619 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.quota [None req-a3cb65ef-611f-4f4d-99b1-6c6f7ee4e390 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Getting quotas for project 345d0f5c3c2842e0940d216397b5cd51. Resources: {'key_pairs'} {{(pid=107262) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 13 02:32:15.033376 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.quota [None req-a3cb65ef-611f-4f4d-99b1-6c6f7ee4e390 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Getting quotas for user 2e23950a4bea4e70a2a8be2c2dd9743e and project 345d0f5c3c2842e0940d216397b5cd51. Resources: {'key_pairs'} {{(pid=107262) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 13 02:32:15.048740 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-a3cb65ef-611f-4f4d-99b1-6c6f7ee4e390 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.450195 Jul 13 02:32:15.049474 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 375/778] 10.222.0.32 () {60 vars in 1158 bytes} [Tue Jul 13 02:32:14 2021] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:32:15.086364 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-2de2d276-cb91-411d-8ed9-ad7a80190a64 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:15.089251 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:15.089251 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:15.097209 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-2de2d276-cb91-411d-8ed9-ad7a80190a64 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1548 microversion: 2.1 time: 0.243580 Jul 13 02:32:15.097873 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 404/779] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:32:14 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1548 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:32:15.113653 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-efbd3336-4486-43c1-b275-91068bfccebf tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:15.114567 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-efbd3336-4486-43c1-b275-91068bfccebf tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:15.121276 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-efbd3336-4486-43c1-b275-91068bfccebf tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:15.121721 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-efbd3336-4486-43c1-b275-91068bfccebf tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:15.122525 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-efbd3336-4486-43c1-b275-91068bfccebf tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:15.123048 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-efbd3336-4486-43c1-b275-91068bfccebf tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:15.125979 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:15.125979 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:15.280243 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-a805e88e-70f4-4bfc-9bde-d89e9dde0f3e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:15.281440 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-a805e88e-70f4-4bfc-9bde-d89e9dde0f3e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:15.289061 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a805e88e-70f4-4bfc-9bde-d89e9dde0f3e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:15.289829 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a805e88e-70f4-4bfc-9bde-d89e9dde0f3e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:15.291555 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a805e88e-70f4-4bfc-9bde-d89e9dde0f3e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:15.292245 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a805e88e-70f4-4bfc-9bde-d89e9dde0f3e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:15.295996 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:15.295996 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:15.403450 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-efbd3336-4486-43c1-b275-91068bfccebf tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:15.407977 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:15.407977 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:15.427999 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-efbd3336-4486-43c1-b275-91068bfccebf tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1548 microversion: 2.1 time: 0.318835 Jul 13 02:32:15.434019 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 376/780] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:32:15 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1548 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:32:15.463099 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-79d878d6-b020-4998-8c2f-bafae8780340 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:15.466237 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:32:15.466237 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:32:15.467365 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-79d878d6-b020-4998-8c2f-bafae8780340 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:15.473109 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-a805e88e-70f4-4bfc-9bde-d89e9dde0f3e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action" status: 200 len: 38198 microversion: 2.20 time: 0.196097 Jul 13 02:32:15.474011 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 405/781] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:32:15 2021] POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action => generated 38198 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Jul 13 02:32:15.475104 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-79d878d6-b020-4998-8c2f-bafae8780340 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Searching by: {'deleted': False, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564'} {{(pid=107262) get_all /opt/stack/nova/nova/compute/api.py:2835}} Jul 13 02:32:15.485072 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-79d878d6-b020-4998-8c2f-bafae8780340 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:15.485847 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-79d878d6-b020-4998-8c2f-bafae8780340 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:15.488310 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-79d878d6-b020-4998-8c2f-bafae8780340 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:15.488702 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-79d878d6-b020-4998-8c2f-bafae8780340 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:15.493429 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1810: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:15.493429 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _instances_fill_metadata(context, query_prefix.all(), manual_joins) Jul 13 02:32:15.595610 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1466: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:15.595610 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: for row in _instance_metadata_get_multi(context, uuids): Jul 13 02:32:15.604579 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.multi_cell_list [None req-79d878d6-b020-4998-8c2f-bafae8780340 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=107262) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Jul 13 02:32:15.678847 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-b36bf753-3e74-4854-b2fb-c2dc07358d5c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:15.680353 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-b36bf753-3e74-4854-b2fb-c2dc07358d5c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:15.686708 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1810: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:15.686708 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _instances_fill_metadata(context, query_prefix.all(), manual_joins) Jul 13 02:32:15.688219 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b36bf753-3e74-4854-b2fb-c2dc07358d5c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:15.688860 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b36bf753-3e74-4854-b2fb-c2dc07358d5c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:15.690646 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b36bf753-3e74-4854-b2fb-c2dc07358d5c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:15.691448 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b36bf753-3e74-4854-b2fb-c2dc07358d5c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:15.695792 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:15.695792 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:15.738200 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-79d878d6-b020-4998-8c2f-bafae8780340 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.291038 Jul 13 02:32:15.739859 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 377/782] 10.222.0.32 () {58 vars in 1125 bytes} [Tue Jul 13 02:32:15 2021] GET /compute/v2.1/servers => generated 342 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:32:15.751604 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-e7940251-4bef-46df-8386-27980245111a tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:15.754483 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-e7940251-4bef-46df-8386-27980245111a tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:15.762018 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e7940251-4bef-46df-8386-27980245111a tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:15.762581 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e7940251-4bef-46df-8386-27980245111a tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:15.763708 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e7940251-4bef-46df-8386-27980245111a tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:15.764331 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e7940251-4bef-46df-8386-27980245111a tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:15.769977 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:15.769977 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:15.899091 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-b36bf753-3e74-4854-b2fb-c2dc07358d5c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action" status: 200 len: 14 microversion: 2.1 time: 0.225559 Jul 13 02:32:15.900053 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 406/783] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:32:15 2021] POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action => generated 14 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 13 02:32:16.013675 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-e7940251-4bef-46df-8386-27980245111a tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:16.016502 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:16.016502 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:16.024483 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-e7940251-4bef-46df-8386-27980245111a tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1548 microversion: 2.1 time: 0.277663 Jul 13 02:32:16.026067 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 378/784] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:32:15 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1548 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:32:16.485570 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-329a0fe5-68dc-42b9-ae1e-8ae42ac5963e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:16.486811 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-329a0fe5-68dc-42b9-ae1e-8ae42ac5963e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:16.497616 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-329a0fe5-68dc-42b9-ae1e-8ae42ac5963e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:16.498390 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-329a0fe5-68dc-42b9-ae1e-8ae42ac5963e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:16.500319 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-329a0fe5-68dc-42b9-ae1e-8ae42ac5963e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:16.501040 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-329a0fe5-68dc-42b9-ae1e-8ae42ac5963e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:16.504836 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:16.504836 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:16.652119 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-329a0fe5-68dc-42b9-ae1e-8ae42ac5963e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action" status: 200 len: 38213 microversion: 2.20 time: 0.170744 Jul 13 02:32:16.652779 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 407/785] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:32:16 2021] POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action => generated 38213 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:32:16.910559 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-0cc412cc-319b-437f-bae9-7d958c8bb2cb tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:16.911521 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-0cc412cc-319b-437f-bae9-7d958c8bb2cb tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:16.917378 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-0cc412cc-319b-437f-bae9-7d958c8bb2cb tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:16.917828 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-0cc412cc-319b-437f-bae9-7d958c8bb2cb tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:16.918637 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-0cc412cc-319b-437f-bae9-7d958c8bb2cb tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:16.919089 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-0cc412cc-319b-437f-bae9-7d958c8bb2cb tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:16.922003 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:16.922003 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:17.052266 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-0cc412cc-319b-437f-bae9-7d958c8bb2cb tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action" status: 200 len: 14 microversion: 2.1 time: 0.145703 Jul 13 02:32:17.052902 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 379/786] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:32:16 2021] POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 13 02:32:17.666229 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-5bd90bc6-5f35-4d8f-bef9-0b51d2b8a338 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:17.667966 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-5bd90bc6-5f35-4d8f-bef9-0b51d2b8a338 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:17.676747 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5bd90bc6-5f35-4d8f-bef9-0b51d2b8a338 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:17.677395 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5bd90bc6-5f35-4d8f-bef9-0b51d2b8a338 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:17.678476 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5bd90bc6-5f35-4d8f-bef9-0b51d2b8a338 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:17.679062 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5bd90bc6-5f35-4d8f-bef9-0b51d2b8a338 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:17.682719 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:17.682719 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:17.713795 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-232af078-f955-4096-8f92-7950c2612b0e tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9c7459b-9196-4ba2-97e0-3052d4fc8cef"}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:17.718306 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-232af078-f955-4096-8f92-7950c2612b0e tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:17.734302 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-232af078-f955-4096-8f92-7950c2612b0e tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:17.734929 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-232af078-f955-4096-8f92-7950c2612b0e tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:17.736042 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-232af078-f955-4096-8f92-7950c2612b0e tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:17.741642 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-232af078-f955-4096-8f92-7950c2612b0e tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:17.745879 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:17.745879 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:17.852106 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-5bd90bc6-5f35-4d8f-bef9-0b51d2b8a338 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action" status: 200 len: 38341 microversion: 2.20 time: 0.191195 Jul 13 02:32:17.854081 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 408/787] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:32:17 2021] POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action => generated 38341 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:32:17.866268 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-0a8638e3-76f9-468b-93d1-047ee317effd tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:17.867291 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-0a8638e3-76f9-468b-93d1-047ee317effd tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:17.874781 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0a8638e3-76f9-468b-93d1-047ee317effd tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:17.875681 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0a8638e3-76f9-468b-93d1-047ee317effd tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:17.876702 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0a8638e3-76f9-468b-93d1-047ee317effd tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:17.877562 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0a8638e3-76f9-468b-93d1-047ee317effd tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:17.881395 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:17.881395 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:17.937461 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3019: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:17.937461 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context, Jul 13 02:32:17.968514 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-0a8638e3-76f9-468b-93d1-047ee317effd tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/ips" status: 200 len: 151 microversion: 2.20 time: 0.107805 Jul 13 02:32:17.970067 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 409/788] 10.222.0.32 () {60 vars in 1289 bytes} [Tue Jul 13 02:32:17 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/ips => generated 151 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:32:18.032058 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2940: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:18.032058 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: query.update(values) Jul 13 02:32:18.039715 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2941: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:18.039715 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return query.first() Jul 13 02:32:18.063564 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-4da0e65a-665f-4f2c-bdef-e22d994de246 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:18.064780 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-4da0e65a-665f-4f2c-bdef-e22d994de246 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:18.072199 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4da0e65a-665f-4f2c-bdef-e22d994de246 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:18.072726 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4da0e65a-665f-4f2c-bdef-e22d994de246 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:18.081001 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4da0e65a-665f-4f2c-bdef-e22d994de246 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:18.081759 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4da0e65a-665f-4f2c-bdef-e22d994de246 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:18.085966 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:18.085966 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:18.168900 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2940: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:18.168900 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: query.update(values) Jul 13 02:32:18.172103 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2941: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:18.172103 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return query.first() Jul 13 02:32:18.209704 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-232af078-f955-4096-8f92-7950c2612b0e tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "POST /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.507632 Jul 13 02:32:18.228655 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 380/789] 10.222.0.32 () {60 vars in 1323 bytes} [Tue Jul 13 02:32:17 2021] POST /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525/os-volume_attachments => generated 194 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:32:18.471265 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-4da0e65a-665f-4f2c-bdef-e22d994de246 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action" status: 200 len: 14 microversion: 2.1 time: 0.411152 Jul 13 02:32:18.472265 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 410/790] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:32:18 2021] POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action => generated 14 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 13 02:32:19.483702 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-7bbcbb2c-b93b-4bff-908e-de660d1ac670 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:19.484754 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-7bbcbb2c-b93b-4bff-908e-de660d1ac670 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:19.492242 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7bbcbb2c-b93b-4bff-908e-de660d1ac670 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:19.492697 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7bbcbb2c-b93b-4bff-908e-de660d1ac670 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:19.493472 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7bbcbb2c-b93b-4bff-908e-de660d1ac670 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:19.493908 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7bbcbb2c-b93b-4bff-908e-de660d1ac670 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:19.496645 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:19.496645 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:19.629025 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-7bbcbb2c-b93b-4bff-908e-de660d1ac670 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action" status: 200 len: 14 microversion: 2.1 time: 0.149647 Jul 13 02:32:19.629641 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 381/791] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:32:19 2021] POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action => generated 14 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 13 02:32:20.219175 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-ef6436f9-b482-43f1-b115-5026c0696478 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:20.219789 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-ef6436f9-b482-43f1-b115-5026c0696478 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:20.226289 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ef6436f9-b482-43f1-b115-5026c0696478 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:20.226736 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ef6436f9-b482-43f1-b115-5026c0696478 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:20.227493 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ef6436f9-b482-43f1-b115-5026c0696478 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:20.227924 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ef6436f9-b482-43f1-b115-5026c0696478 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:20.230569 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:20.230569 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:20.289125 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.objects.instance [None req-ef6436f9-b482-43f1-b115-5026c0696478 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lazy-loading 'flavor' on Instance uuid bcded031-14e6-4fa5-9a79-7e26c1aa0a0f {{(pid=107263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 13 02:32:20.307580 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2557: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:20.307580 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: rows_updated = model_query(context, models.InstanceExtra).\ Jul 13 02:32:20.316087 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:20.316087 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:20.371004 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/update_match.py:472: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:20.371004 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = query.session.execute(update_stmt) Jul 13 02:32:20.391893 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3008: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:20.391893 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).\ Jul 13 02:32:20.583522 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-ef6436f9-b482-43f1-b115-5026c0696478 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action" status: 202 len: 0 microversion: 2.20 time: 0.368288 Jul 13 02:32:20.584165 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 411/792] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:32:20 2021] POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 13 02:32:20.592555 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-669c970a-034f-45dc-b575-f1ec3c9520de tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:20.593253 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-669c970a-034f-45dc-b575-f1ec3c9520de tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:20.600700 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-669c970a-034f-45dc-b575-f1ec3c9520de tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:20.601149 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-669c970a-034f-45dc-b575-f1ec3c9520de tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:20.602105 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-669c970a-034f-45dc-b575-f1ec3c9520de tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:20.602605 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-669c970a-034f-45dc-b575-f1ec3c9520de tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:20.606191 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:20.606191 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:20.641610 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-16d6cfa9-bf1f-47a7-96e2-35ec0e026585 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:20.642688 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-16d6cfa9-bf1f-47a7-96e2-35ec0e026585 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:20.649260 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-16d6cfa9-bf1f-47a7-96e2-35ec0e026585 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:20.649701 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-16d6cfa9-bf1f-47a7-96e2-35ec0e026585 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:20.650493 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-16d6cfa9-bf1f-47a7-96e2-35ec0e026585 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:20.650924 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-16d6cfa9-bf1f-47a7-96e2-35ec0e026585 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:20.653611 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:20.653611 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:20.785509 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-16d6cfa9-bf1f-47a7-96e2-35ec0e026585 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action" status: 200 len: 3200 microversion: 2.1 time: 0.148909 Jul 13 02:32:20.786172 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 412/793] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:32:20 2021] POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action => generated 3200 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:32:20.789917 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-669c970a-034f-45dc-b575-f1ec3c9520de tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:20.792717 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:20.792717 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:20.800526 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-669c970a-034f-45dc-b575-f1ec3c9520de tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:20.802041 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-669c970a-034f-45dc-b575-f1ec3c9520de tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:20.803194 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-669c970a-034f-45dc-b575-f1ec3c9520de tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1723 microversion: 2.20 time: 0.214709 Jul 13 02:32:20.803752 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 382/794] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:32:20 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:32:21.797216 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-1f9892e0-96b5-4df3-ab11-c5ebdac656bd tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:21.798295 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-1f9892e0-96b5-4df3-ab11-c5ebdac656bd tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:21.805276 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-1f9892e0-96b5-4df3-ab11-c5ebdac656bd tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:21.805726 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-1f9892e0-96b5-4df3-ab11-c5ebdac656bd tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:21.806570 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-1f9892e0-96b5-4df3-ab11-c5ebdac656bd tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:21.806946 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-1f9892e0-96b5-4df3-ab11-c5ebdac656bd tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:21.809877 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:21.809877 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:21.820840 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-b5cd85c8-1347-414d-838f-abd2534d35a6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:21.821444 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-b5cd85c8-1347-414d-838f-abd2534d35a6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:21.827697 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b5cd85c8-1347-414d-838f-abd2534d35a6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:21.828139 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b5cd85c8-1347-414d-838f-abd2534d35a6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:21.828900 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b5cd85c8-1347-414d-838f-abd2534d35a6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:21.829520 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b5cd85c8-1347-414d-838f-abd2534d35a6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:21.832740 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:21.832740 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:21.947445 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-1f9892e0-96b5-4df3-ab11-c5ebdac656bd tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action" status: 200 len: 11929 microversion: 2.1 time: 0.154053 Jul 13 02:32:21.951090 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 413/795] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:32:21 2021] POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action => generated 11929 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:32:22.010907 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-b5cd85c8-1347-414d-838f-abd2534d35a6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:22.013803 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:22.013803 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:22.022206 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-b5cd85c8-1347-414d-838f-abd2534d35a6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:22.023705 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-b5cd85c8-1347-414d-838f-abd2534d35a6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:22.024932 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-b5cd85c8-1347-414d-838f-abd2534d35a6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1723 microversion: 2.20 time: 0.207745 Jul 13 02:32:22.025471 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 383/796] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:32:21 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:32:22.959366 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-46d287c9-f11b-41e0-ad4a-0f27e60a3366 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:22.960358 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-46d287c9-f11b-41e0-ad4a-0f27e60a3366 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:22.966752 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-46d287c9-f11b-41e0-ad4a-0f27e60a3366 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:22.967201 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-46d287c9-f11b-41e0-ad4a-0f27e60a3366 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:22.967963 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-46d287c9-f11b-41e0-ad4a-0f27e60a3366 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:22.968394 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-46d287c9-f11b-41e0-ad4a-0f27e60a3366 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:22.971081 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:22.971081 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:23.043828 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-39374ba7-1f00-4490-83dc-a09a2d1be8b8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:23.044410 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-39374ba7-1f00-4490-83dc-a09a2d1be8b8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:23.051271 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-39374ba7-1f00-4490-83dc-a09a2d1be8b8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:23.051721 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-39374ba7-1f00-4490-83dc-a09a2d1be8b8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:23.052479 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-39374ba7-1f00-4490-83dc-a09a2d1be8b8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:23.052905 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-39374ba7-1f00-4490-83dc-a09a2d1be8b8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:23.055759 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:23.055759 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:23.094969 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-46d287c9-f11b-41e0-ad4a-0f27e60a3366 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action" status: 200 len: 17742 microversion: 2.1 time: 0.139587 Jul 13 02:32:23.099307 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 414/797] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:32:22 2021] POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action => generated 17742 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:32:23.228267 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-39374ba7-1f00-4490-83dc-a09a2d1be8b8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:23.230833 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:23.230833 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:23.238870 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-39374ba7-1f00-4490-83dc-a09a2d1be8b8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:23.240371 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-39374ba7-1f00-4490-83dc-a09a2d1be8b8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:23.241506 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-39374ba7-1f00-4490-83dc-a09a2d1be8b8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1723 microversion: 2.20 time: 0.201325 Jul 13 02:32:23.242081 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 384/798] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:32:23 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:32:24.106874 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-93d10171-191b-4fa0-99da-5f36ec0625b5 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:24.107814 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-93d10171-191b-4fa0-99da-5f36ec0625b5 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:24.114314 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-93d10171-191b-4fa0-99da-5f36ec0625b5 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:24.114763 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-93d10171-191b-4fa0-99da-5f36ec0625b5 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:24.115524 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-93d10171-191b-4fa0-99da-5f36ec0625b5 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:24.115955 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-93d10171-191b-4fa0-99da-5f36ec0625b5 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:24.118823 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:24.118823 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:24.251572 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-93d10171-191b-4fa0-99da-5f36ec0625b5 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action" status: 200 len: 18561 microversion: 2.1 time: 0.148668 Jul 13 02:32:24.252218 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 415/799] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:32:24 2021] POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action => generated 18561 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:32:24.260861 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-a62456de-c67c-4f79-ab92-645c6c961523 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:24.261555 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-a62456de-c67c-4f79-ab92-645c6c961523 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:24.268988 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a62456de-c67c-4f79-ab92-645c6c961523 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:24.268988 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a62456de-c67c-4f79-ab92-645c6c961523 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:24.269476 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a62456de-c67c-4f79-ab92-645c6c961523 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:24.269901 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a62456de-c67c-4f79-ab92-645c6c961523 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:24.272761 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:24.272761 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:24.451131 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-a62456de-c67c-4f79-ab92-645c6c961523 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:24.453644 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:24.453644 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:24.460978 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-a62456de-c67c-4f79-ab92-645c6c961523 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:24.462524 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-a62456de-c67c-4f79-ab92-645c6c961523 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:24.463648 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-a62456de-c67c-4f79-ab92-645c6c961523 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1723 microversion: 2.20 time: 0.206429 Jul 13 02:32:24.464186 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 385/800] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:32:24 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:32:25.263574 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-27583c32-8c3a-4b3e-9aac-a7ff0a3f57e7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:25.264491 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-27583c32-8c3a-4b3e-9aac-a7ff0a3f57e7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:25.271719 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-27583c32-8c3a-4b3e-9aac-a7ff0a3f57e7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:25.272190 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-27583c32-8c3a-4b3e-9aac-a7ff0a3f57e7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:25.272955 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-27583c32-8c3a-4b3e-9aac-a7ff0a3f57e7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:25.273396 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-27583c32-8c3a-4b3e-9aac-a7ff0a3f57e7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:25.276743 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:25.276743 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:25.410727 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-27583c32-8c3a-4b3e-9aac-a7ff0a3f57e7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action" status: 200 len: 20675 microversion: 2.1 time: 0.151260 Jul 13 02:32:25.411384 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 416/801] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:32:25 2021] POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action => generated 20675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:32:25.481476 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-1382478f-8f91-444f-a58c-32c61b580ab8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:25.482104 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-1382478f-8f91-444f-a58c-32c61b580ab8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:25.488059 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1382478f-8f91-444f-a58c-32c61b580ab8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:25.488508 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1382478f-8f91-444f-a58c-32c61b580ab8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:25.489270 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1382478f-8f91-444f-a58c-32c61b580ab8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:25.489698 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1382478f-8f91-444f-a58c-32c61b580ab8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:25.492549 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:25.492549 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:25.668297 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-1382478f-8f91-444f-a58c-32c61b580ab8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:25.670884 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:25.670884 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:25.678337 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-1382478f-8f91-444f-a58c-32c61b580ab8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:25.679824 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-1382478f-8f91-444f-a58c-32c61b580ab8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:25.680959 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-1382478f-8f91-444f-a58c-32c61b580ab8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1723 microversion: 2.20 time: 0.203217 Jul 13 02:32:25.681516 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 386/802] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:32:25 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:32:25.856978 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-7e121160-5695-42fc-8c3c-1d75b48dcf21 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:25.857712 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-7e121160-5695-42fc-8c3c-1d75b48dcf21 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:25.865288 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7e121160-5695-42fc-8c3c-1d75b48dcf21 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:25.866215 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7e121160-5695-42fc-8c3c-1d75b48dcf21 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:25.867143 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7e121160-5695-42fc-8c3c-1d75b48dcf21 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:25.867786 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7e121160-5695-42fc-8c3c-1d75b48dcf21 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:25.871027 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:25.871027 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:26.046977 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-7e121160-5695-42fc-8c3c-1d75b48dcf21 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:26.049566 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:26.049566 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:26.057891 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-7e121160-5695-42fc-8c3c-1d75b48dcf21 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1594 microversion: 2.1 time: 0.204945 Jul 13 02:32:26.058545 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 417/803] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:32:25 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1594 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:32:26.421959 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-977d8224-3a54-4721-9a4d-0fa82ce17109 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:26.422899 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-977d8224-3a54-4721-9a4d-0fa82ce17109 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:26.429468 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-977d8224-3a54-4721-9a4d-0fa82ce17109 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:26.429920 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-977d8224-3a54-4721-9a4d-0fa82ce17109 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:26.430731 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-977d8224-3a54-4721-9a4d-0fa82ce17109 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:26.431167 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-977d8224-3a54-4721-9a4d-0fa82ce17109 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:26.433850 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:26.433850 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:26.593578 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-977d8224-3a54-4721-9a4d-0fa82ce17109 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action" status: 200 len: 22540 microversion: 2.1 time: 0.175040 Jul 13 02:32:26.594294 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 387/804] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:32:26 2021] POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action => generated 22540 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:32:26.700352 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-c6e9499b-70d8-4550-bd71-b239ccb5f8cd tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:26.701180 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-c6e9499b-70d8-4550-bd71-b239ccb5f8cd tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:26.707603 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c6e9499b-70d8-4550-bd71-b239ccb5f8cd tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:26.708123 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c6e9499b-70d8-4550-bd71-b239ccb5f8cd tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:26.708909 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c6e9499b-70d8-4550-bd71-b239ccb5f8cd tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:26.709341 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c6e9499b-70d8-4550-bd71-b239ccb5f8cd tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:26.712421 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:26.712421 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:27.270814 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-c6e9499b-70d8-4550-bd71-b239ccb5f8cd tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:27.273518 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:27.273518 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:27.283529 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-c6e9499b-70d8-4550-bd71-b239ccb5f8cd tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:27.285235 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-c6e9499b-70d8-4550-bd71-b239ccb5f8cd tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:27.286433 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-c6e9499b-70d8-4550-bd71-b239ccb5f8cd tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1723 microversion: 2.20 time: 0.589964 Jul 13 02:32:27.286983 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 418/805] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:32:26 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1723 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:32:27.605938 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-09f3b0d8-07da-424c-8461-3bc1da27b0b0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:27.607608 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-09f3b0d8-07da-424c-8461-3bc1da27b0b0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:27.615273 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-09f3b0d8-07da-424c-8461-3bc1da27b0b0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:27.615767 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-09f3b0d8-07da-424c-8461-3bc1da27b0b0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:27.616535 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-09f3b0d8-07da-424c-8461-3bc1da27b0b0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:27.616965 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-09f3b0d8-07da-424c-8461-3bc1da27b0b0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:27.619763 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:27.619763 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:27.756118 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-09f3b0d8-07da-424c-8461-3bc1da27b0b0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action" status: 200 len: 23594 microversion: 2.1 time: 0.154248 Jul 13 02:32:27.759932 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 388/806] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:32:27 2021] POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action => generated 23594 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:32:28.173580 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [req-53ec9b09-8199-42e9-be41-d7d26a7e8964 req-3b24d925-6220-4329-9703-289712193bc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "578a1bf5-b64e-45c5-ac82-32809189a525", "tag": "bc4abdbb-fe6a-4872-b0b8-aca5ec258475"}]} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:28.174644 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:32:28.174644 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: warnings.warn(msg) Jul 13 02:32:28.181534 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-53ec9b09-8199-42e9-be41-d7d26a7e8964 req-3b24d925-6220-4329-9703-289712193bc5 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:28.181988 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-53ec9b09-8199-42e9-be41-d7d26a7e8964 req-3b24d925-6220-4329-9703-289712193bc5 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:28.193772 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.compute.server_external_events [req-53ec9b09-8199-42e9-be41-d7d26a7e8964 req-3b24d925-6220-4329-9703-289712193bc5 service nova] Creating event network-changed:bc4abdbb-fe6a-4872-b0b8-aca5ec258475 for instance 578a1bf5-b64e-45c5-ac82-32809189a525 on hv-cinder-78102 Jul 13 02:32:28.201792 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [req-53ec9b09-8199-42e9-be41-d7d26a7e8964 req-3b24d925-6220-4329-9703-289712193bc5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029299 Jul 13 02:32:28.202418 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 419/807] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:32:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:32:28.306079 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-614ea48a-8b18-44cc-a2d4-30acc92f6bc7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:28.306945 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-614ea48a-8b18-44cc-a2d4-30acc92f6bc7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:28.323044 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-614ea48a-8b18-44cc-a2d4-30acc92f6bc7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:28.323683 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-614ea48a-8b18-44cc-a2d4-30acc92f6bc7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:28.324631 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-614ea48a-8b18-44cc-a2d4-30acc92f6bc7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:28.325065 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-614ea48a-8b18-44cc-a2d4-30acc92f6bc7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:28.328400 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:28.328400 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:28.643537 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-614ea48a-8b18-44cc-a2d4-30acc92f6bc7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:28.649369 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:28.649369 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:28.666919 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-614ea48a-8b18-44cc-a2d4-30acc92f6bc7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:28.670165 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-614ea48a-8b18-44cc-a2d4-30acc92f6bc7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:28.680651 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-614ea48a-8b18-44cc-a2d4-30acc92f6bc7 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1723 microversion: 2.20 time: 0.377187 Jul 13 02:32:28.683945 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 389/808] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:32:28 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1723 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:32:28.768204 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-5eade089-31a1-486e-932b-8935514f171e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:28.769672 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-5eade089-31a1-486e-932b-8935514f171e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:28.783774 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5eade089-31a1-486e-932b-8935514f171e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:28.784775 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5eade089-31a1-486e-932b-8935514f171e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:28.786247 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5eade089-31a1-486e-932b-8935514f171e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:28.786668 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5eade089-31a1-486e-932b-8935514f171e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:28.789914 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:28.789914 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:28.962990 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-5eade089-31a1-486e-932b-8935514f171e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action" status: 200 len: 24748 microversion: 2.1 time: 0.196507 Jul 13 02:32:28.965463 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 420/809] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:32:28 2021] POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action => generated 24748 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:32:29.261138 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-a24dd83a-dd6e-4a10-a459-f6cd2a4c4d5e tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-82635105"}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:29.261681 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-a24dd83a-dd6e-4a10-a459-f6cd2a4c4d5e tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:29.267631 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a24dd83a-dd6e-4a10-a459-f6cd2a4c4d5e tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:29.268082 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a24dd83a-dd6e-4a10-a459-f6cd2a4c4d5e tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:29.268922 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a24dd83a-dd6e-4a10-a459-f6cd2a4c4d5e tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:29.269362 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a24dd83a-dd6e-4a10-a459-f6cd2a4c4d5e tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:29.272300 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:29.272300 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:29.447860 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.network.security_group_api [None req-a24dd83a-dd6e-4a10-a459-f6cd2a4c4d5e tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Adding security group 04b50ca5-d374-47b2-be59-e8ff3a2b65a6 to port bc4abdbb-fe6a-4872-b0b8-aca5ec258475 Jul 13 02:32:29.702335 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-af17f3c3-1df0-47c5-8a83-4e486d93683e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:29.703133 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-af17f3c3-1df0-47c5-8a83-4e486d93683e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:29.709708 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-af17f3c3-1df0-47c5-8a83-4e486d93683e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:29.710267 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-af17f3c3-1df0-47c5-8a83-4e486d93683e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:29.711102 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-af17f3c3-1df0-47c5-8a83-4e486d93683e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:29.711536 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-af17f3c3-1df0-47c5-8a83-4e486d93683e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:29.714452 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:29.714452 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:29.863487 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-a24dd83a-dd6e-4a10-a459-f6cd2a4c4d5e tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "POST /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525/action" status: 202 len: 0 microversion: 2.1 time: 0.603843 Jul 13 02:32:29.864359 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 390/810] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:32:29 2021] POST /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525/action => generated 0 bytes in 607 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 13 02:32:29.873325 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-1e7cd504-eac1-4188-a7ab-343dad07b1bb tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:29.875453 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-1e7cd504-eac1-4188-a7ab-343dad07b1bb tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:29.887403 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1e7cd504-eac1-4188-a7ab-343dad07b1bb tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:29.888557 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1e7cd504-eac1-4188-a7ab-343dad07b1bb tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:29.889879 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1e7cd504-eac1-4188-a7ab-343dad07b1bb tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:29.890502 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1e7cd504-eac1-4188-a7ab-343dad07b1bb tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:29.895077 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:29.895077 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:29.994247 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-af17f3c3-1df0-47c5-8a83-4e486d93683e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:29.997570 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:29.997570 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:30.010750 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-af17f3c3-1df0-47c5-8a83-4e486d93683e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:30.018944 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-af17f3c3-1df0-47c5-8a83-4e486d93683e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:30.020177 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-af17f3c3-1df0-47c5-8a83-4e486d93683e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1723 microversion: 2.20 time: 0.321958 Jul 13 02:32:30.020825 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 421/811] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:32:29 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1723 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:32:30.031563 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-7c5c7579-89fe-4040-aca4-7fc9d0baff1f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:30.032508 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-7c5c7579-89fe-4040-aca4-7fc9d0baff1f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:30.046885 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7c5c7579-89fe-4040-aca4-7fc9d0baff1f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:30.047610 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7c5c7579-89fe-4040-aca4-7fc9d0baff1f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:30.048104 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7c5c7579-89fe-4040-aca4-7fc9d0baff1f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:30.048536 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7c5c7579-89fe-4040-aca4-7fc9d0baff1f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:30.057954 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:30.057954 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:30.148833 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-1e7cd504-eac1-4188-a7ab-343dad07b1bb tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:30.151691 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:30.151691 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:30.159881 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-1e7cd504-eac1-4188-a7ab-343dad07b1bb tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1758 microversion: 2.1 time: 0.290444 Jul 13 02:32:30.160820 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 391/812] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:32:29 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1758 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:32:30.206122 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-7c5c7579-89fe-4040-aca4-7fc9d0baff1f tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action" status: 200 len: 25918 microversion: 2.1 time: 0.183978 Jul 13 02:32:30.207715 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 422/813] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:32:30 2021] POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action => generated 25918 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:32:30.217460 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-1635e63b-1c44-446f-b1dd-a31b3ff533f7 req-6bdc257d-39a9-4e85-b6cb-6e03e5048cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "578a1bf5-b64e-45c5-ac82-32809189a525", "tag": "bc4abdbb-fe6a-4872-b0b8-aca5ec258475"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:30.219013 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:32:30.219013 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:32:30.226512 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-1635e63b-1c44-446f-b1dd-a31b3ff533f7 req-6bdc257d-39a9-4e85-b6cb-6e03e5048cc8 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:30.226951 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-1635e63b-1c44-446f-b1dd-a31b3ff533f7 req-6bdc257d-39a9-4e85-b6cb-6e03e5048cc8 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:30.238082 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-1635e63b-1c44-446f-b1dd-a31b3ff533f7 req-6bdc257d-39a9-4e85-b6cb-6e03e5048cc8 service nova] Creating event network-changed:bc4abdbb-fe6a-4872-b0b8-aca5ec258475 for instance 578a1bf5-b64e-45c5-ac82-32809189a525 on hv-cinder-78102 Jul 13 02:32:30.243169 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-1635e63b-1c44-446f-b1dd-a31b3ff533f7 req-6bdc257d-39a9-4e85-b6cb-6e03e5048cc8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029392 Jul 13 02:32:30.243974 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 392/814] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:32:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:32:31.039498 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-44486fa8-1d39-4b12-aa02-4dd8c7bad84b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:31.040192 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-44486fa8-1d39-4b12-aa02-4dd8c7bad84b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:31.046778 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-44486fa8-1d39-4b12-aa02-4dd8c7bad84b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:31.047232 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-44486fa8-1d39-4b12-aa02-4dd8c7bad84b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:31.047994 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-44486fa8-1d39-4b12-aa02-4dd8c7bad84b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:31.048430 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-44486fa8-1d39-4b12-aa02-4dd8c7bad84b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:31.051935 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:31.051935 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:31.217819 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-f70196a4-af5f-46b1-92fa-a0f5be49ec75 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:31.218858 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-f70196a4-af5f-46b1-92fa-a0f5be49ec75 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:31.221195 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-44486fa8-1d39-4b12-aa02-4dd8c7bad84b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:31.223791 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:31.223791 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:31.225307 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f70196a4-af5f-46b1-92fa-a0f5be49ec75 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:31.225755 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f70196a4-af5f-46b1-92fa-a0f5be49ec75 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:31.226559 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f70196a4-af5f-46b1-92fa-a0f5be49ec75 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:31.226990 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f70196a4-af5f-46b1-92fa-a0f5be49ec75 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:31.229737 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:31.229737 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:31.231247 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-44486fa8-1d39-4b12-aa02-4dd8c7bad84b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:31.232766 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-44486fa8-1d39-4b12-aa02-4dd8c7bad84b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:31.233908 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-44486fa8-1d39-4b12-aa02-4dd8c7bad84b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1723 microversion: 2.20 time: 0.198612 Jul 13 02:32:31.234493 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 423/815] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:32:31 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:32:31.381937 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-f70196a4-af5f-46b1-92fa-a0f5be49ec75 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action" status: 200 len: 26787 microversion: 2.1 time: 0.167881 Jul 13 02:32:31.382626 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 393/816] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:32:31 2021] POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action => generated 26787 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 13 02:32:32.252803 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-07ee71de-82a8-4185-be92-c607f22b34d8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:32.254115 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-07ee71de-82a8-4185-be92-c607f22b34d8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:32.260394 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-07ee71de-82a8-4185-be92-c607f22b34d8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:32.260835 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-07ee71de-82a8-4185-be92-c607f22b34d8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:32.261595 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-07ee71de-82a8-4185-be92-c607f22b34d8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:32.262147 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-07ee71de-82a8-4185-be92-c607f22b34d8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:32.265190 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:32.265190 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:32.394278 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-442c497d-104e-42cf-8f15-259cf87bf2b3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:32.395778 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-442c497d-104e-42cf-8f15-259cf87bf2b3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:32.401915 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-442c497d-104e-42cf-8f15-259cf87bf2b3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:32.402378 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-442c497d-104e-42cf-8f15-259cf87bf2b3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:32.403141 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-442c497d-104e-42cf-8f15-259cf87bf2b3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:32.403567 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-442c497d-104e-42cf-8f15-259cf87bf2b3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:32.406262 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:32.406262 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:32.450513 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-07ee71de-82a8-4185-be92-c607f22b34d8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:32.453058 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:32.453058 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:32.461317 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-07ee71de-82a8-4185-be92-c607f22b34d8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:32.462886 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-07ee71de-82a8-4185-be92-c607f22b34d8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:32.463973 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-07ee71de-82a8-4185-be92-c607f22b34d8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1744 microversion: 2.20 time: 0.214964 Jul 13 02:32:32.464538 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 424/817] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:32:32 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1744 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:32:32.541921 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-442c497d-104e-42cf-8f15-259cf87bf2b3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action" status: 200 len: 27551 microversion: 2.1 time: 0.151511 Jul 13 02:32:32.542510 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 394/818] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:32:32 2021] POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action => generated 27551 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 13 02:32:33.483327 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-7277b2b0-ab2e-4c96-809a-aeb2cf2ae481 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:33.484076 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-7277b2b0-ab2e-4c96-809a-aeb2cf2ae481 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:33.494590 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7277b2b0-ab2e-4c96-809a-aeb2cf2ae481 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:33.495348 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7277b2b0-ab2e-4c96-809a-aeb2cf2ae481 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:33.496628 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7277b2b0-ab2e-4c96-809a-aeb2cf2ae481 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:33.497370 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7277b2b0-ab2e-4c96-809a-aeb2cf2ae481 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:33.501551 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:33.501551 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:33.555815 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-5a8634ad-635a-4ab3-9a43-864e2bf4fef2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:33.557034 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-5a8634ad-635a-4ab3-9a43-864e2bf4fef2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:33.563776 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5a8634ad-635a-4ab3-9a43-864e2bf4fef2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:33.564219 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5a8634ad-635a-4ab3-9a43-864e2bf4fef2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:33.564998 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5a8634ad-635a-4ab3-9a43-864e2bf4fef2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:33.565424 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5a8634ad-635a-4ab3-9a43-864e2bf4fef2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:33.569246 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:33.569246 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:33.687334 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-7277b2b0-ab2e-4c96-809a-aeb2cf2ae481 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:33.690043 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:33.690043 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:33.699335 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-7277b2b0-ab2e-4c96-809a-aeb2cf2ae481 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:33.701630 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-7277b2b0-ab2e-4c96-809a-aeb2cf2ae481 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:33.703247 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-7277b2b0-ab2e-4c96-809a-aeb2cf2ae481 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1744 microversion: 2.20 time: 0.223481 Jul 13 02:32:33.704059 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 425/819] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:32:33 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1744 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:32:33.710213 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-5a8634ad-635a-4ab3-9a43-864e2bf4fef2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action" status: 200 len: 27791 microversion: 2.1 time: 0.158324 Jul 13 02:32:33.714459 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 395/820] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:32:33 2021] POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action => generated 27791 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 13 02:32:34.723566 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-f018612f-b066-484e-9406-a6f5b3603c63 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:34.724570 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-f018612f-b066-484e-9406-a6f5b3603c63 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:34.730378 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [req-3da0f03c-7b92-49ab-96b1-f8aa5b1b0195 req-a9162342-5534-4605-8f37-d8fd1fe16332 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcded031-14e6-4fa5-9a79-7e26c1aa0a0f", "name": "network-vif-plugged", "status": "completed", "tag": "9e88c5ac-8fb9-44a9-a7fc-b323f20644f2"}]} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:34.731934 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:32:34.731934 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: warnings.warn(msg) Jul 13 02:32:34.734702 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f018612f-b066-484e-9406-a6f5b3603c63 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:34.738949 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-3da0f03c-7b92-49ab-96b1-f8aa5b1b0195 req-a9162342-5534-4605-8f37-d8fd1fe16332 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:34.739416 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-3da0f03c-7b92-49ab-96b1-f8aa5b1b0195 req-a9162342-5534-4605-8f37-d8fd1fe16332 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:34.739844 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f018612f-b066-484e-9406-a6f5b3603c63 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:34.740782 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f018612f-b066-484e-9406-a6f5b3603c63 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:34.741541 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f018612f-b066-484e-9406-a6f5b3603c63 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:34.745072 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:34.745072 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:34.751247 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.compute.server_external_events [req-3da0f03c-7b92-49ab-96b1-f8aa5b1b0195 req-a9162342-5534-4605-8f37-d8fd1fe16332 service nova] Creating event network-vif-plugged:9e88c5ac-8fb9-44a9-a7fc-b323f20644f2 for instance bcded031-14e6-4fa5-9a79-7e26c1aa0a0f on hv-cinder-78102 Jul 13 02:32:34.756135 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [req-3da0f03c-7b92-49ab-96b1-f8aa5b1b0195 req-a9162342-5534-4605-8f37-d8fd1fe16332 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089814 Jul 13 02:32:34.756756 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 426/821] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:32:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 02:32:34.761744 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-92871541-26f9-4e9f-bafd-2b261b176a73 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:34.763021 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-92871541-26f9-4e9f-bafd-2b261b176a73 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:34.769851 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-92871541-26f9-4e9f-bafd-2b261b176a73 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:34.770522 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-92871541-26f9-4e9f-bafd-2b261b176a73 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:34.772604 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-92871541-26f9-4e9f-bafd-2b261b176a73 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:34.772604 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-92871541-26f9-4e9f-bafd-2b261b176a73 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:34.777751 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:34.777751 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:34.924395 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-92871541-26f9-4e9f-bafd-2b261b176a73 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action" status: 200 len: 28030 microversion: 2.1 time: 0.165975 Jul 13 02:32:34.925873 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 427/822] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:32:34 2021] POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action => generated 28030 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:32:34.950576 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-eddc0c9e-6316-4ec0-add4-4e73c08074e1 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2109231873", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-96975266", "security_groups": [{"name": "tempest-secgroup-smoke-327206247"}], "block_device_mapping_v2": [{"uuid": "4e0aef80-ad62-46e4-8d00-2820ceb901c8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "afd43932-4582-4e2a-8e2b-804f55bae1f7"}]}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:34.957457 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-f018612f-b066-484e-9406-a6f5b3603c63 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:34.960590 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:34.960590 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:34.969598 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-f018612f-b066-484e-9406-a6f5b3603c63 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:34.971133 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-f018612f-b066-484e-9406-a6f5b3603c63 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:34.972522 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-f018612f-b066-484e-9406-a6f5b3603c63 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1744 microversion: 2.20 time: 0.253759 Jul 13 02:32:34.973073 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 396/823] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:32:34 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1744 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:32:35.069815 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.network.neutron [None req-eddc0c9e-6316-4ec0-add4-4e73c08074e1 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] validate_networks() for [('afd43932-4582-4e2a-8e2b-804f55bae1f7', None, None, None)] {{(pid=107263) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Jul 13 02:32:35.486118 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-eddc0c9e-6316-4ec0-add4-4e73c08074e1 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Flavor limits 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 02:32:35.486549 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-eddc0c9e-6316-4ec0-add4-4e73c08074e1 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Image limits 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 02:32:35.487028 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-eddc0c9e-6316-4ec0-add4-4e73c08074e1 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Flavor pref 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 02:32:35.487483 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-eddc0c9e-6316-4ec0-add4-4e73c08074e1 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Image pref 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 02:32:35.487897 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-eddc0c9e-6316-4ec0-add4-4e73c08074e1 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 02:32:35.493809 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2690: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:35.493809 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: user_quotas = model_query(context, models.ProjectUserQuota, Jul 13 02:32:35.497566 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-eddc0c9e-6316-4ec0-add4-4e73c08074e1 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:35.498041 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-eddc0c9e-6316-4ec0-add4-4e73c08074e1 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:35.498857 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-eddc0c9e-6316-4ec0-add4-4e73c08074e1 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:35.499315 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-eddc0c9e-6316-4ec0-add4-4e73c08074e1 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:35.504153 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/objects/instance.py:1537: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:35.504153 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: project_result = project_query.first() Jul 13 02:32:35.516522 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2708: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:35.516522 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: rows = model_query(context, models.Quota, read_deleted="no").\ Jul 13 02:32:35.520969 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.quota [None req-eddc0c9e-6316-4ec0-add4-4e73c08074e1 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Getting quotas for project 345d0f5c3c2842e0940d216397b5cd51. Resources: {'ram', 'cores', 'instances'} {{(pid=107263) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 13 02:32:35.525002 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.quota [None req-eddc0c9e-6316-4ec0-add4-4e73c08074e1 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Getting quotas for user 2e23950a4bea4e70a2a8be2c2dd9743e and project 345d0f5c3c2842e0940d216397b5cd51. Resources: {'ram', 'cores', 'instances'} {{(pid=107263) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 13 02:32:35.586140 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-eddc0c9e-6316-4ec0-add4-4e73c08074e1 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Going to run 1 instances... {{(pid=107263) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 13 02:32:35.588315 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-eddc0c9e-6316-4ec0-add4-4e73c08074e1 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d57716e0-3826-4e42-ad25-42cd46585692] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4e0aef80-ad62-46e4-8d00-2820ceb901c8',volume_size=None,volume_type=None)] {{(pid=107263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 13 02:32:35.711319 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-eddc0c9e-6316-4ec0-add4-4e73c08074e1 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.765826 Jul 13 02:32:35.711954 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 428/824] 10.222.0.32 () {60 vars in 1147 bytes} [Tue Jul 13 02:32:34 2021] POST /compute/v2.1/servers => generated 405 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 02:32:35.721552 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-82133096-b4e7-4da7-857d-5909412005dd tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:35.723267 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-82133096-b4e7-4da7-857d-5909412005dd tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d57716e0-3826-4e42-ad25-42cd46585692] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:35.779685 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-82133096-b4e7-4da7-857d-5909412005dd tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:35.783258 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:35.783258 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:35.790854 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-82133096-b4e7-4da7-857d-5909412005dd tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/d57716e0-3826-4e42-ad25-42cd46585692" status: 200 len: 1093 microversion: 2.1 time: 0.072878 Jul 13 02:32:35.791423 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 397/825] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:32:35 2021] GET /compute/v2.1/servers/d57716e0-3826-4e42-ad25-42cd46585692 => generated 1093 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:32:35.938515 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-fd6056a5-fb94-40d0-bc6a-770686e944ee tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:35.939509 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-fd6056a5-fb94-40d0-bc6a-770686e944ee tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:35.945848 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-fd6056a5-fb94-40d0-bc6a-770686e944ee tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:35.946336 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-fd6056a5-fb94-40d0-bc6a-770686e944ee tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:35.947125 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-fd6056a5-fb94-40d0-bc6a-770686e944ee tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:35.947561 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-fd6056a5-fb94-40d0-bc6a-770686e944ee tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:35.950963 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:35.950963 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:35.994251 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-261c0a92-b229-455b-9c34-ad71bf981a87 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:35.996196 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-261c0a92-b229-455b-9c34-ad71bf981a87 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:36.017180 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-261c0a92-b229-455b-9c34-ad71bf981a87 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:36.018391 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-261c0a92-b229-455b-9c34-ad71bf981a87 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:36.019566 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-261c0a92-b229-455b-9c34-ad71bf981a87 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:36.020595 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-261c0a92-b229-455b-9c34-ad71bf981a87 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:36.025329 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:36.025329 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:36.088286 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-fd6056a5-fb94-40d0-bc6a-770686e944ee tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action" status: 200 len: 28214 microversion: 2.1 time: 0.153312 Jul 13 02:32:36.093370 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 429/826] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:32:35 2021] POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action => generated 28214 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:32:36.233416 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-261c0a92-b229-455b-9c34-ad71bf981a87 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:36.238497 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:36.238497 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:36.251688 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-261c0a92-b229-455b-9c34-ad71bf981a87 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:36.253492 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-261c0a92-b229-455b-9c34-ad71bf981a87 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:36.254997 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-261c0a92-b229-455b-9c34-ad71bf981a87 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1739 microversion: 2.20 time: 0.265299 Jul 13 02:32:36.255718 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 398/827] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:32:35 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1739 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:32:36.809556 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-18a91a83-b220-485c-b2d8-502e8b339f11 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:36.810318 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-18a91a83-b220-485c-b2d8-502e8b339f11 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d57716e0-3826-4e42-ad25-42cd46585692] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:36.817601 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-18a91a83-b220-485c-b2d8-502e8b339f11 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:36.818309 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-18a91a83-b220-485c-b2d8-502e8b339f11 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:36.819299 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-18a91a83-b220-485c-b2d8-502e8b339f11 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:36.819736 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-18a91a83-b220-485c-b2d8-502e8b339f11 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:36.824793 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:36.824793 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:36.952944 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-18a91a83-b220-485c-b2d8-502e8b339f11 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:36.956039 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:36.956039 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:36.967614 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-18a91a83-b220-485c-b2d8-502e8b339f11 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/d57716e0-3826-4e42-ad25-42cd46585692" status: 200 len: 1191 microversion: 2.1 time: 0.162723 Jul 13 02:32:36.968744 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 430/828] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:32:36 2021] GET /compute/v2.1/servers/d57716e0-3826-4e42-ad25-42cd46585692 => generated 1191 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:32:37.100982 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-802faca7-6177-45e4-b9dc-cbd0804b7eaf tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:37.102764 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-802faca7-6177-45e4-b9dc-cbd0804b7eaf tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:37.113307 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-802faca7-6177-45e4-b9dc-cbd0804b7eaf tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:37.114092 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-802faca7-6177-45e4-b9dc-cbd0804b7eaf tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:37.115079 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-802faca7-6177-45e4-b9dc-cbd0804b7eaf tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:37.115738 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-802faca7-6177-45e4-b9dc-cbd0804b7eaf tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:37.135690 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:37.135690 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:37.275179 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-99962e4d-1bd2-41a0-96b4-5ecc019e79d5 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:37.276103 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-99962e4d-1bd2-41a0-96b4-5ecc019e79d5 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:37.287057 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-99962e4d-1bd2-41a0-96b4-5ecc019e79d5 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:37.287775 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-99962e4d-1bd2-41a0-96b4-5ecc019e79d5 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:37.288573 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-99962e4d-1bd2-41a0-96b4-5ecc019e79d5 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:37.289174 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-99962e4d-1bd2-41a0-96b4-5ecc019e79d5 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:37.293146 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:37.293146 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:37.297682 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-802faca7-6177-45e4-b9dc-cbd0804b7eaf tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action" status: 200 len: 28214 microversion: 2.1 time: 0.200696 Jul 13 02:32:37.298826 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 399/829] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:32:37 2021] POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action => generated 28214 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 13 02:32:37.654912 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-99962e4d-1bd2-41a0-96b4-5ecc019e79d5 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:37.658631 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:37.658631 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:37.673462 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-99962e4d-1bd2-41a0-96b4-5ecc019e79d5 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:37.675480 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-99962e4d-1bd2-41a0-96b4-5ecc019e79d5 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:37.676917 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-99962e4d-1bd2-41a0-96b4-5ecc019e79d5 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1739 microversion: 2.20 time: 0.405579 Jul 13 02:32:37.677701 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 431/830] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:32:37 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1739 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:32:37.989357 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-a58790e9-2f72-4304-92d7-6f40eb0b2031 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:37.990638 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-a58790e9-2f72-4304-92d7-6f40eb0b2031 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d57716e0-3826-4e42-ad25-42cd46585692] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:38.000357 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a58790e9-2f72-4304-92d7-6f40eb0b2031 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:38.001229 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a58790e9-2f72-4304-92d7-6f40eb0b2031 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:38.003909 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a58790e9-2f72-4304-92d7-6f40eb0b2031 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:38.004940 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a58790e9-2f72-4304-92d7-6f40eb0b2031 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:38.017386 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:38.017386 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:38.310740 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-a3c93ec4-e42f-41cd-ac3a-11fc8276f16c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:38.311700 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-a3c93ec4-e42f-41cd-ac3a-11fc8276f16c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:38.320908 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a3c93ec4-e42f-41cd-ac3a-11fc8276f16c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:38.321355 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a3c93ec4-e42f-41cd-ac3a-11fc8276f16c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:38.335136 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a3c93ec4-e42f-41cd-ac3a-11fc8276f16c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:38.335830 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a3c93ec4-e42f-41cd-ac3a-11fc8276f16c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:38.339637 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:38.339637 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:38.520640 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-a3c93ec4-e42f-41cd-ac3a-11fc8276f16c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action" status: 200 len: 28214 microversion: 2.1 time: 0.213245 Jul 13 02:32:38.521676 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 432/831] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:32:38 2021] POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action => generated 28214 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:32:38.753857 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-6d04228e-31d7-497b-a5e2-11402cdd439b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:38.754953 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-6d04228e-31d7-497b-a5e2-11402cdd439b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:38.762138 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6d04228e-31d7-497b-a5e2-11402cdd439b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:38.763193 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6d04228e-31d7-497b-a5e2-11402cdd439b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:38.764202 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6d04228e-31d7-497b-a5e2-11402cdd439b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:38.764856 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6d04228e-31d7-497b-a5e2-11402cdd439b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:38.768680 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:38.768680 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:38.798597 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-a58790e9-2f72-4304-92d7-6f40eb0b2031 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:38.802662 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:38.802662 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:38.813669 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-a58790e9-2f72-4304-92d7-6f40eb0b2031 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/d57716e0-3826-4e42-ad25-42cd46585692" status: 200 len: 1276 microversion: 2.1 time: 0.832371 Jul 13 02:32:38.825056 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 400/832] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:32:37 2021] GET /compute/v2.1/servers/d57716e0-3826-4e42-ad25-42cd46585692 => generated 1276 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:32:39.072812 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-6d04228e-31d7-497b-a5e2-11402cdd439b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:39.075607 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:39.075607 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:39.085347 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-6d04228e-31d7-497b-a5e2-11402cdd439b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:39.087201 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-6d04228e-31d7-497b-a5e2-11402cdd439b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:39.089391 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-6d04228e-31d7-497b-a5e2-11402cdd439b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1739 microversion: 2.20 time: 0.339190 Jul 13 02:32:39.099687 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 433/833] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:32:38 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1739 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:32:39.532962 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-8dedbdf9-666f-4778-8f97-df1faec62fa7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:39.533917 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-8dedbdf9-666f-4778-8f97-df1faec62fa7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:39.541327 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8dedbdf9-666f-4778-8f97-df1faec62fa7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:39.542252 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8dedbdf9-666f-4778-8f97-df1faec62fa7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:39.543040 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8dedbdf9-666f-4778-8f97-df1faec62fa7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:39.543472 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8dedbdf9-666f-4778-8f97-df1faec62fa7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:39.547768 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:39.547768 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:39.562078 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-31a6a69f-16a3-4ad0-8681-d85acabebfa5 req-92e9cc60-98e0-46c5-a976-e0ac40e44360 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d57716e0-3826-4e42-ad25-42cd46585692", "tag": "a5ebc0a6-1594-4ae0-8308-07615056f845"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:39.563619 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:32:39.563619 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:32:39.572563 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-31a6a69f-16a3-4ad0-8681-d85acabebfa5 req-92e9cc60-98e0-46c5-a976-e0ac40e44360 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:39.573014 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-31a6a69f-16a3-4ad0-8681-d85acabebfa5 req-92e9cc60-98e0-46c5-a976-e0ac40e44360 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:39.588216 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-31a6a69f-16a3-4ad0-8681-d85acabebfa5 req-92e9cc60-98e0-46c5-a976-e0ac40e44360 service nova] Creating event network-changed:a5ebc0a6-1594-4ae0-8308-07615056f845 for instance d57716e0-3826-4e42-ad25-42cd46585692 on hv-cinder-78102 Jul 13 02:32:39.593280 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-31a6a69f-16a3-4ad0-8681-d85acabebfa5 req-92e9cc60-98e0-46c5-a976-e0ac40e44360 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142633 Jul 13 02:32:39.594328 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 401/834] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:32:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:32:39.720319 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-8dedbdf9-666f-4778-8f97-df1faec62fa7 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action" status: 200 len: 28505 microversion: 2.1 time: 0.190856 Jul 13 02:32:39.724650 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 434/835] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:32:39 2021] POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action => generated 28505 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 13 02:32:39.833130 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-406c0ee4-93a7-4bda-953a-26d517d295c9 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:39.835238 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-406c0ee4-93a7-4bda-953a-26d517d295c9 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d57716e0-3826-4e42-ad25-42cd46585692] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:39.842973 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-406c0ee4-93a7-4bda-953a-26d517d295c9 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:39.843683 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-406c0ee4-93a7-4bda-953a-26d517d295c9 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:39.845093 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-406c0ee4-93a7-4bda-953a-26d517d295c9 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:39.845798 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-406c0ee4-93a7-4bda-953a-26d517d295c9 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:39.849899 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:39.849899 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:40.108167 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-e4437eee-96f2-4974-9a6e-945b14f37cb1 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:40.109056 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-e4437eee-96f2-4974-9a6e-945b14f37cb1 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:40.116588 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e4437eee-96f2-4974-9a6e-945b14f37cb1 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:40.117379 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e4437eee-96f2-4974-9a6e-945b14f37cb1 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:40.118535 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e4437eee-96f2-4974-9a6e-945b14f37cb1 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:40.119275 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e4437eee-96f2-4974-9a6e-945b14f37cb1 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:40.122707 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:40.122707 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:40.162177 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-406c0ee4-93a7-4bda-953a-26d517d295c9 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:40.165396 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:40.165396 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:40.183289 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-406c0ee4-93a7-4bda-953a-26d517d295c9 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/d57716e0-3826-4e42-ad25-42cd46585692" status: 200 len: 1264 microversion: 2.1 time: 0.354385 Jul 13 02:32:40.195334 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 402/836] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:32:39 2021] GET /compute/v2.1/servers/d57716e0-3826-4e42-ad25-42cd46585692 => generated 1264 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:32:40.373783 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-e4437eee-96f2-4974-9a6e-945b14f37cb1 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:40.380280 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:40.380280 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:40.389139 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-e4437eee-96f2-4974-9a6e-945b14f37cb1 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:40.390833 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-e4437eee-96f2-4974-9a6e-945b14f37cb1 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:40.392388 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-e4437eee-96f2-4974-9a6e-945b14f37cb1 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1739 microversion: 2.20 time: 0.288981 Jul 13 02:32:40.393261 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 435/837] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:32:40 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1739 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:32:40.733254 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-f5d6c9fa-78b3-4caf-bb37-1cbce901c137 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:40.734347 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-f5d6c9fa-78b3-4caf-bb37-1cbce901c137 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:40.740975 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f5d6c9fa-78b3-4caf-bb37-1cbce901c137 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:40.741720 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f5d6c9fa-78b3-4caf-bb37-1cbce901c137 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:40.742725 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f5d6c9fa-78b3-4caf-bb37-1cbce901c137 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:40.743369 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f5d6c9fa-78b3-4caf-bb37-1cbce901c137 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:40.746398 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:40.746398 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:40.900864 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-f5d6c9fa-78b3-4caf-bb37-1cbce901c137 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action" status: 200 len: 28673 microversion: 2.1 time: 0.172006 Jul 13 02:32:40.901544 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 403/838] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:32:40 2021] POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action => generated 28673 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:32:41.202190 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-10805982-d964-4b93-a381-720ee6a9e997 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:41.202805 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-10805982-d964-4b93-a381-720ee6a9e997 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d57716e0-3826-4e42-ad25-42cd46585692] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:41.210608 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-10805982-d964-4b93-a381-720ee6a9e997 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:41.211053 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-10805982-d964-4b93-a381-720ee6a9e997 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:41.211825 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-10805982-d964-4b93-a381-720ee6a9e997 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:41.212254 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-10805982-d964-4b93-a381-720ee6a9e997 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:41.216975 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:41.216975 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:41.412562 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-a726346d-35e6-4648-9bef-daff9dc9d164 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:41.413496 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-a726346d-35e6-4648-9bef-daff9dc9d164 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:41.420003 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a726346d-35e6-4648-9bef-daff9dc9d164 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:41.420747 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a726346d-35e6-4648-9bef-daff9dc9d164 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:41.421751 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a726346d-35e6-4648-9bef-daff9dc9d164 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:41.422423 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a726346d-35e6-4648-9bef-daff9dc9d164 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:41.425850 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:41.425850 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:41.434682 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-10805982-d964-4b93-a381-720ee6a9e997 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:41.437961 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:41.437961 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:41.446057 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-10805982-d964-4b93-a381-720ee6a9e997 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/d57716e0-3826-4e42-ad25-42cd46585692" status: 200 len: 1264 microversion: 2.1 time: 0.249232 Jul 13 02:32:41.446833 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 436/839] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:32:41 2021] GET /compute/v2.1/servers/d57716e0-3826-4e42-ad25-42cd46585692 => generated 1264 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:32:41.630970 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-a726346d-35e6-4648-9bef-daff9dc9d164 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:41.633743 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:41.633743 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:41.642099 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-a726346d-35e6-4648-9bef-daff9dc9d164 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:41.643642 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-a726346d-35e6-4648-9bef-daff9dc9d164 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:41.644792 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-a726346d-35e6-4648-9bef-daff9dc9d164 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1739 microversion: 2.20 time: 0.236663 Jul 13 02:32:41.645342 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 404/840] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:32:41 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1739 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:32:41.913681 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-668b7ed8-e0ee-48ee-966d-65787c0b4b41 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:41.914550 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-668b7ed8-e0ee-48ee-966d-65787c0b4b41 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:41.920865 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-668b7ed8-e0ee-48ee-966d-65787c0b4b41 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:41.921811 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-668b7ed8-e0ee-48ee-966d-65787c0b4b41 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:41.923370 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-668b7ed8-e0ee-48ee-966d-65787c0b4b41 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:41.924246 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-668b7ed8-e0ee-48ee-966d-65787c0b4b41 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:41.927886 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:41.927886 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:42.067020 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-668b7ed8-e0ee-48ee-966d-65787c0b4b41 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action" status: 200 len: 28673 microversion: 2.1 time: 0.157711 Jul 13 02:32:42.068388 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 437/841] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:32:41 2021] POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action => generated 28673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:32:42.463471 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-75a06044-4fba-4d68-acc7-f43205dc1541 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:42.464183 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-75a06044-4fba-4d68-acc7-f43205dc1541 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d57716e0-3826-4e42-ad25-42cd46585692] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:42.470578 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-75a06044-4fba-4d68-acc7-f43205dc1541 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:42.471330 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-75a06044-4fba-4d68-acc7-f43205dc1541 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:42.472398 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-75a06044-4fba-4d68-acc7-f43205dc1541 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:42.473210 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-75a06044-4fba-4d68-acc7-f43205dc1541 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:42.478146 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:42.478146 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:42.663959 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-b836fef1-ea3d-4142-b3b9-1ad6500cbbca tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:42.664643 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-b836fef1-ea3d-4142-b3b9-1ad6500cbbca tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:42.671293 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b836fef1-ea3d-4142-b3b9-1ad6500cbbca tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:42.671823 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b836fef1-ea3d-4142-b3b9-1ad6500cbbca tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:42.672666 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b836fef1-ea3d-4142-b3b9-1ad6500cbbca tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:42.673296 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-b836fef1-ea3d-4142-b3b9-1ad6500cbbca tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:42.676839 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:42.676839 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:42.678278 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-75a06044-4fba-4d68-acc7-f43205dc1541 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:42.681193 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:42.681193 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:42.688656 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-75a06044-4fba-4d68-acc7-f43205dc1541 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/d57716e0-3826-4e42-ad25-42cd46585692" status: 200 len: 1264 microversion: 2.1 time: 0.229928 Jul 13 02:32:42.689589 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 405/842] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:32:42 2021] GET /compute/v2.1/servers/d57716e0-3826-4e42-ad25-42cd46585692 => generated 1264 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:32:42.870295 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-b836fef1-ea3d-4142-b3b9-1ad6500cbbca tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:42.873240 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:42.873240 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:42.881602 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-b836fef1-ea3d-4142-b3b9-1ad6500cbbca tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:42.883237 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-b836fef1-ea3d-4142-b3b9-1ad6500cbbca tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:42.884386 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-b836fef1-ea3d-4142-b3b9-1ad6500cbbca tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1739 microversion: 2.20 time: 0.225243 Jul 13 02:32:42.885110 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 438/843] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:32:42 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1739 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:32:43.079251 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-08152d93-8a9e-493e-85e9-2350a7ead1ff tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:43.080151 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-08152d93-8a9e-493e-85e9-2350a7ead1ff tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:43.090402 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-08152d93-8a9e-493e-85e9-2350a7ead1ff tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:43.090402 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-08152d93-8a9e-493e-85e9-2350a7ead1ff tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:43.090402 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-08152d93-8a9e-493e-85e9-2350a7ead1ff tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:43.090402 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-08152d93-8a9e-493e-85e9-2350a7ead1ff tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:43.092156 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:43.092156 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:43.228945 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-08152d93-8a9e-493e-85e9-2350a7ead1ff tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action" status: 200 len: 28673 microversion: 2.1 time: 0.153290 Jul 13 02:32:43.229855 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 406/844] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:32:43 2021] POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action => generated 28673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:32:43.706513 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-bec3d276-32d5-4fc2-8dfd-b20255e08f01 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:43.709706 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-bec3d276-32d5-4fc2-8dfd-b20255e08f01 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d57716e0-3826-4e42-ad25-42cd46585692] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:43.716442 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-bec3d276-32d5-4fc2-8dfd-b20255e08f01 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:43.716999 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-bec3d276-32d5-4fc2-8dfd-b20255e08f01 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:43.717882 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-bec3d276-32d5-4fc2-8dfd-b20255e08f01 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:43.718424 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-bec3d276-32d5-4fc2-8dfd-b20255e08f01 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:43.721433 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:43.721433 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:43.905694 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-f23c3bca-230b-4fec-969d-18f07ca31dae tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:43.906570 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-f23c3bca-230b-4fec-969d-18f07ca31dae tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:43.914926 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f23c3bca-230b-4fec-969d-18f07ca31dae tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:43.915375 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f23c3bca-230b-4fec-969d-18f07ca31dae tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:43.916153 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f23c3bca-230b-4fec-969d-18f07ca31dae tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:43.916736 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f23c3bca-230b-4fec-969d-18f07ca31dae tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:43.919925 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:43.919925 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:43.928837 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-bec3d276-32d5-4fc2-8dfd-b20255e08f01 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:43.931587 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:43.931587 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:43.941144 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-bec3d276-32d5-4fc2-8dfd-b20255e08f01 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/d57716e0-3826-4e42-ad25-42cd46585692" status: 200 len: 1264 microversion: 2.1 time: 0.238127 Jul 13 02:32:43.942077 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 439/845] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:32:43 2021] GET /compute/v2.1/servers/d57716e0-3826-4e42-ad25-42cd46585692 => generated 1264 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:32:44.102191 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-f23c3bca-230b-4fec-969d-18f07ca31dae tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:44.105049 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:44.105049 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:44.113133 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-f23c3bca-230b-4fec-969d-18f07ca31dae tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:44.114665 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-f23c3bca-230b-4fec-969d-18f07ca31dae tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:44.115822 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-f23c3bca-230b-4fec-969d-18f07ca31dae tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1739 microversion: 2.20 time: 0.215851 Jul 13 02:32:44.122824 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 407/846] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:32:43 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1739 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:32:44.240972 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-c8bfcfb7-4571-431f-9a5f-8fad310c63a3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:44.242059 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-c8bfcfb7-4571-431f-9a5f-8fad310c63a3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:44.249654 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c8bfcfb7-4571-431f-9a5f-8fad310c63a3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:44.250390 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c8bfcfb7-4571-431f-9a5f-8fad310c63a3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:44.251387 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c8bfcfb7-4571-431f-9a5f-8fad310c63a3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:44.252241 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c8bfcfb7-4571-431f-9a5f-8fad310c63a3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:44.256997 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:44.256997 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:44.401014 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-c8bfcfb7-4571-431f-9a5f-8fad310c63a3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action" status: 200 len: 29005 microversion: 2.1 time: 0.163641 Jul 13 02:32:44.404889 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 440/847] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:32:44 2021] POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action => generated 29005 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 13 02:32:44.957915 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-030b53bd-335d-41d0-a09a-9f910b379e7d tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:44.958726 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-030b53bd-335d-41d0-a09a-9f910b379e7d tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d57716e0-3826-4e42-ad25-42cd46585692] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:44.965537 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-030b53bd-335d-41d0-a09a-9f910b379e7d tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:44.965989 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-030b53bd-335d-41d0-a09a-9f910b379e7d tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:44.966840 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-030b53bd-335d-41d0-a09a-9f910b379e7d tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:44.967286 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-030b53bd-335d-41d0-a09a-9f910b379e7d tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:44.970815 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:44.970815 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:45.134632 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-3d0b479f-7c77-4e24-9cc3-8566ec2d98ca tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:45.135334 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-3d0b479f-7c77-4e24-9cc3-8566ec2d98ca tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:45.142498 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-3d0b479f-7c77-4e24-9cc3-8566ec2d98ca tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:45.143186 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-3d0b479f-7c77-4e24-9cc3-8566ec2d98ca tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:45.144522 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-3d0b479f-7c77-4e24-9cc3-8566ec2d98ca tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:45.145126 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-3d0b479f-7c77-4e24-9cc3-8566ec2d98ca tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:45.148577 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:45.148577 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:45.164549 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-030b53bd-335d-41d0-a09a-9f910b379e7d tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:45.167555 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:45.167555 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:45.177210 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-030b53bd-335d-41d0-a09a-9f910b379e7d tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/d57716e0-3826-4e42-ad25-42cd46585692" status: 200 len: 1264 microversion: 2.1 time: 0.221600 Jul 13 02:32:45.178612 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 408/848] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:32:44 2021] GET /compute/v2.1/servers/d57716e0-3826-4e42-ad25-42cd46585692 => generated 1264 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:32:45.353222 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-3d0b479f-7c77-4e24-9cc3-8566ec2d98ca tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:45.356223 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:45.356223 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:45.364746 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-3d0b479f-7c77-4e24-9cc3-8566ec2d98ca tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:45.366328 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-3d0b479f-7c77-4e24-9cc3-8566ec2d98ca tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:45.367829 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-3d0b479f-7c77-4e24-9cc3-8566ec2d98ca tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1739 microversion: 2.20 time: 0.237355 Jul 13 02:32:45.368546 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 441/849] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:32:45 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1739 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:32:45.412816 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-da4fb329-9238-402d-a3d4-7711393101c2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:45.413762 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-da4fb329-9238-402d-a3d4-7711393101c2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:45.420367 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-da4fb329-9238-402d-a3d4-7711393101c2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:45.420804 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-da4fb329-9238-402d-a3d4-7711393101c2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:45.421846 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-da4fb329-9238-402d-a3d4-7711393101c2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:45.422564 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-da4fb329-9238-402d-a3d4-7711393101c2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:45.425760 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:45.425760 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:45.567899 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-da4fb329-9238-402d-a3d4-7711393101c2 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action" status: 200 len: 30872 microversion: 2.1 time: 0.159141 Jul 13 02:32:45.568621 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 409/850] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:32:45 2021] POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action => generated 30872 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:32:46.194494 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-59e9c845-e5e6-4d7b-b213-37243583966a tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:46.195101 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-59e9c845-e5e6-4d7b-b213-37243583966a tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d57716e0-3826-4e42-ad25-42cd46585692] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:46.201202 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-59e9c845-e5e6-4d7b-b213-37243583966a tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:46.201641 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-59e9c845-e5e6-4d7b-b213-37243583966a tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:46.202432 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-59e9c845-e5e6-4d7b-b213-37243583966a tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:46.202860 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-59e9c845-e5e6-4d7b-b213-37243583966a tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:46.205737 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:46.205737 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:46.376420 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-59e9c845-e5e6-4d7b-b213-37243583966a tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:46.379267 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:46.379267 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:46.386518 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-59e9c845-e5e6-4d7b-b213-37243583966a tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/d57716e0-3826-4e42-ad25-42cd46585692" status: 200 len: 1264 microversion: 2.1 time: 0.196347 Jul 13 02:32:46.386909 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-da21a1ea-bebe-498a-b2c0-8e5780549ce6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:46.387417 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 442/851] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:32:46 2021] GET /compute/v2.1/servers/d57716e0-3826-4e42-ad25-42cd46585692 => generated 1264 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:32:46.388052 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-da21a1ea-bebe-498a-b2c0-8e5780549ce6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:46.394821 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-da21a1ea-bebe-498a-b2c0-8e5780549ce6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:46.395282 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-da21a1ea-bebe-498a-b2c0-8e5780549ce6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:46.396055 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-da21a1ea-bebe-498a-b2c0-8e5780549ce6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:46.396492 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-da21a1ea-bebe-498a-b2c0-8e5780549ce6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:46.399418 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:46.399418 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:46.575461 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-da21a1ea-bebe-498a-b2c0-8e5780549ce6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:46.578008 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:46.578008 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:46.579524 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-062b91c4-f8fa-4485-bc00-699e66c87cd4 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:46.580448 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-062b91c4-f8fa-4485-bc00-699e66c87cd4 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:46.585562 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-da21a1ea-bebe-498a-b2c0-8e5780549ce6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:46.586474 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-062b91c4-f8fa-4485-bc00-699e66c87cd4 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:46.586923 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-062b91c4-f8fa-4485-bc00-699e66c87cd4 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:46.587080 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-da21a1ea-bebe-498a-b2c0-8e5780549ce6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:46.587698 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-062b91c4-f8fa-4485-bc00-699e66c87cd4 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:46.588156 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-062b91c4-f8fa-4485-bc00-699e66c87cd4 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:46.588269 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-da21a1ea-bebe-498a-b2c0-8e5780549ce6 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1739 microversion: 2.20 time: 0.205492 Jul 13 02:32:46.588762 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 410/852] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:32:46 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1739 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:32:46.591029 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:46.591029 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:46.729615 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-062b91c4-f8fa-4485-bc00-699e66c87cd4 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action" status: 200 len: 32226 microversion: 2.1 time: 0.153597 Jul 13 02:32:46.733421 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 443/853] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:32:46 2021] POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action => generated 32226 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 13 02:32:47.403625 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-8922ecf5-bcf7-4edc-a03d-43fe03d85001 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:47.404232 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-8922ecf5-bcf7-4edc-a03d-43fe03d85001 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d57716e0-3826-4e42-ad25-42cd46585692] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:47.410946 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8922ecf5-bcf7-4edc-a03d-43fe03d85001 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:47.411393 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8922ecf5-bcf7-4edc-a03d-43fe03d85001 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:47.412153 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8922ecf5-bcf7-4edc-a03d-43fe03d85001 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:47.412586 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8922ecf5-bcf7-4edc-a03d-43fe03d85001 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:47.415430 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:47.415430 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:47.587673 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-8922ecf5-bcf7-4edc-a03d-43fe03d85001 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:47.590217 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:47.590217 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:47.597114 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-8922ecf5-bcf7-4edc-a03d-43fe03d85001 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/d57716e0-3826-4e42-ad25-42cd46585692" status: 200 len: 1264 microversion: 2.1 time: 0.197120 Jul 13 02:32:47.597610 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 411/854] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:32:47 2021] GET /compute/v2.1/servers/d57716e0-3826-4e42-ad25-42cd46585692 => generated 1264 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:32:47.607203 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-ea0a3fe5-80ff-46d0-9fb3-bad46aff2295 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:47.607896 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-ea0a3fe5-80ff-46d0-9fb3-bad46aff2295 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:47.615322 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ea0a3fe5-80ff-46d0-9fb3-bad46aff2295 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:47.615766 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ea0a3fe5-80ff-46d0-9fb3-bad46aff2295 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:47.616519 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ea0a3fe5-80ff-46d0-9fb3-bad46aff2295 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:47.616947 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ea0a3fe5-80ff-46d0-9fb3-bad46aff2295 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:47.619803 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:47.619803 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:47.741648 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-872dfe22-3b70-4456-9ef5-323179106ba8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:47.742758 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-872dfe22-3b70-4456-9ef5-323179106ba8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:47.748526 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-872dfe22-3b70-4456-9ef5-323179106ba8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:47.749048 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-872dfe22-3b70-4456-9ef5-323179106ba8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:47.749888 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-872dfe22-3b70-4456-9ef5-323179106ba8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:47.750411 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-872dfe22-3b70-4456-9ef5-323179106ba8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:47.753798 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:47.753798 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:47.795646 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-ea0a3fe5-80ff-46d0-9fb3-bad46aff2295 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:47.798233 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:47.798233 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:47.806489 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-ea0a3fe5-80ff-46d0-9fb3-bad46aff2295 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:47.807971 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-ea0a3fe5-80ff-46d0-9fb3-bad46aff2295 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:47.809103 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-ea0a3fe5-80ff-46d0-9fb3-bad46aff2295 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1721 microversion: 2.20 time: 0.205973 Jul 13 02:32:47.809739 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 444/855] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:32:47 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1721 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:32:47.888614 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-872dfe22-3b70-4456-9ef5-323179106ba8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action" status: 200 len: 33104 microversion: 2.1 time: 0.150696 Jul 13 02:32:47.889182 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 412/856] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:32:47 2021] POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action => generated 33104 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 13 02:32:48.613650 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-52b08e72-1070-4978-aaa3-997a474aa944 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:48.614222 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-52b08e72-1070-4978-aaa3-997a474aa944 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d57716e0-3826-4e42-ad25-42cd46585692] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:48.620405 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-52b08e72-1070-4978-aaa3-997a474aa944 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:48.620849 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-52b08e72-1070-4978-aaa3-997a474aa944 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:48.621603 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-52b08e72-1070-4978-aaa3-997a474aa944 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:48.622063 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-52b08e72-1070-4978-aaa3-997a474aa944 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:48.624868 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:48.624868 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:48.801663 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-52b08e72-1070-4978-aaa3-997a474aa944 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:48.804262 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:48.804262 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:48.811195 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-52b08e72-1070-4978-aaa3-997a474aa944 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/d57716e0-3826-4e42-ad25-42cd46585692" status: 200 len: 1264 microversion: 2.1 time: 0.201630 Jul 13 02:32:48.811772 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 445/857] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:32:48 2021] GET /compute/v2.1/servers/d57716e0-3826-4e42-ad25-42cd46585692 => generated 1264 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:32:48.828854 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-7071c382-4d44-4dce-8962-321ddf83f480 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:48.829555 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-7071c382-4d44-4dce-8962-321ddf83f480 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:48.836583 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7071c382-4d44-4dce-8962-321ddf83f480 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:48.837032 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7071c382-4d44-4dce-8962-321ddf83f480 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:48.837808 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7071c382-4d44-4dce-8962-321ddf83f480 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:48.838270 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7071c382-4d44-4dce-8962-321ddf83f480 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:48.841188 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:48.841188 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:48.900485 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-d432c124-d504-4fcf-9f79-0be5e5ed29c1 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:48.901393 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-d432c124-d504-4fcf-9f79-0be5e5ed29c1 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:48.907087 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d432c124-d504-4fcf-9f79-0be5e5ed29c1 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:48.907553 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d432c124-d504-4fcf-9f79-0be5e5ed29c1 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:48.908297 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d432c124-d504-4fcf-9f79-0be5e5ed29c1 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:48.908730 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d432c124-d504-4fcf-9f79-0be5e5ed29c1 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:48.911474 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:48.911474 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:49.017826 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-7071c382-4d44-4dce-8962-321ddf83f480 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:49.020437 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:49.020437 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:49.027712 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-7071c382-4d44-4dce-8962-321ddf83f480 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:49.029241 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-7071c382-4d44-4dce-8962-321ddf83f480 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:49.030413 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-7071c382-4d44-4dce-8962-321ddf83f480 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1721 microversion: 2.20 time: 0.205562 Jul 13 02:32:49.030962 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 413/858] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:32:48 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1721 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:32:49.057043 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-d432c124-d504-4fcf-9f79-0be5e5ed29c1 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action" status: 200 len: 33782 microversion: 2.1 time: 0.159978 Jul 13 02:32:49.057678 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 446/859] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:32:48 2021] POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action => generated 33782 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 13 02:32:49.827907 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-9a43c70a-3506-479a-8c7e-ea31fe6af466 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:49.828517 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-9a43c70a-3506-479a-8c7e-ea31fe6af466 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d57716e0-3826-4e42-ad25-42cd46585692] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:49.835409 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9a43c70a-3506-479a-8c7e-ea31fe6af466 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:49.835995 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9a43c70a-3506-479a-8c7e-ea31fe6af466 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:49.836711 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9a43c70a-3506-479a-8c7e-ea31fe6af466 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:49.837168 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9a43c70a-3506-479a-8c7e-ea31fe6af466 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:49.840188 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:49.840188 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:50.015677 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-9a43c70a-3506-479a-8c7e-ea31fe6af466 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:50.019196 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:50.019196 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:50.026011 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-9a43c70a-3506-479a-8c7e-ea31fe6af466 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/d57716e0-3826-4e42-ad25-42cd46585692" status: 200 len: 1264 microversion: 2.1 time: 0.201902 Jul 13 02:32:50.026682 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 414/860] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:32:49 2021] GET /compute/v2.1/servers/d57716e0-3826-4e42-ad25-42cd46585692 => generated 1264 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:32:50.048904 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-576a07d4-bc46-443b-9681-6d53b7213147 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:50.049645 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-576a07d4-bc46-443b-9681-6d53b7213147 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:50.056074 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-576a07d4-bc46-443b-9681-6d53b7213147 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:50.056523 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-576a07d4-bc46-443b-9681-6d53b7213147 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:50.057276 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-576a07d4-bc46-443b-9681-6d53b7213147 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:50.057704 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-576a07d4-bc46-443b-9681-6d53b7213147 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:50.060504 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:50.060504 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:50.069173 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-0c042b00-84bb-4f22-b78f-91bb5a689a7e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:50.070213 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-0c042b00-84bb-4f22-b78f-91bb5a689a7e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:50.075993 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-0c042b00-84bb-4f22-b78f-91bb5a689a7e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:50.076435 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-0c042b00-84bb-4f22-b78f-91bb5a689a7e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:50.077346 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-0c042b00-84bb-4f22-b78f-91bb5a689a7e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:50.077783 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-0c042b00-84bb-4f22-b78f-91bb5a689a7e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:50.080629 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:50.080629 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:50.216928 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-0c042b00-84bb-4f22-b78f-91bb5a689a7e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action" status: 200 len: 35045 microversion: 2.1 time: 0.152325 Jul 13 02:32:50.218657 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 415/861] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:32:50 2021] POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action => generated 35045 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 13 02:32:50.236990 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-eb020814-d5ab-41a8-8553-72203ece7574 req-79a54580-0d83-47f0-aec9-dad5c41653b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d57716e0-3826-4e42-ad25-42cd46585692", "name": "network-vif-plugged", "status": "completed", "tag": "a5ebc0a6-1594-4ae0-8308-07615056f845"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:50.239310 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:32:50.239310 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:32:50.242121 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-576a07d4-bc46-443b-9681-6d53b7213147 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:50.245431 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:50.245431 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:50.247162 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-eb020814-d5ab-41a8-8553-72203ece7574 req-79a54580-0d83-47f0-aec9-dad5c41653b6 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:50.247601 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-eb020814-d5ab-41a8-8553-72203ece7574 req-79a54580-0d83-47f0-aec9-dad5c41653b6 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:50.256398 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-576a07d4-bc46-443b-9681-6d53b7213147 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:50.258121 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-576a07d4-bc46-443b-9681-6d53b7213147 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:50.259300 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-576a07d4-bc46-443b-9681-6d53b7213147 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1664 microversion: 2.20 time: 0.214440 Jul 13 02:32:50.260104 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 447/862] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:32:50 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1664 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:32:50.261162 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-eb020814-d5ab-41a8-8553-72203ece7574 req-79a54580-0d83-47f0-aec9-dad5c41653b6 service nova] Creating event network-vif-plugged:a5ebc0a6-1594-4ae0-8308-07615056f845 for instance d57716e0-3826-4e42-ad25-42cd46585692 on hv-cinder-78102 Jul 13 02:32:50.275098 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-eb020814-d5ab-41a8-8553-72203ece7574 req-79a54580-0d83-47f0-aec9-dad5c41653b6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042428 Jul 13 02:32:50.276158 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 416/863] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:32:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:32:50.277257 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-2bb94680-be1b-42d8-b6bf-069af08a11ff tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fbbf8018-f1be-4c1f-a49d-075280cbf518"}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:50.278502 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-2bb94680-be1b-42d8-b6bf-069af08a11ff tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:50.285058 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2bb94680-be1b-42d8-b6bf-069af08a11ff tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:50.285506 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2bb94680-be1b-42d8-b6bf-069af08a11ff tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:50.286307 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2bb94680-be1b-42d8-b6bf-069af08a11ff tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:50.286743 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-2bb94680-be1b-42d8-b6bf-069af08a11ff tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:50.289751 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:50.289751 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:50.411759 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3019: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:50.411759 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context, Jul 13 02:32:50.550650 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2940: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:50.550650 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: query.update(values) Jul 13 02:32:50.553756 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2941: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:50.553756 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return query.first() Jul 13 02:32:50.578398 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:4073: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:50.578398 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = model_query(context, models.InstanceAction).\ Jul 13 02:32:50.697036 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:4158: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:50.697036 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: event_ref = model_query(context, models.InstanceActionEvent).\ Jul 13 02:32:50.707464 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-2bb94680-be1b-42d8-b6bf-069af08a11ff tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.433802 Jul 13 02:32:50.708071 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 448/864] 10.222.0.32 () {62 vars in 1364 bytes} [Tue Jul 13 02:32:50 2021] POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/os-volume_attachments => generated 188 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 13 02:32:50.773047 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-ab988450-73e0-4ae7-a693-73fce0de2828 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:50.773720 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-ab988450-73e0-4ae7-a693-73fce0de2828 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:50.779785 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ab988450-73e0-4ae7-a693-73fce0de2828 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:50.780309 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ab988450-73e0-4ae7-a693-73fce0de2828 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:50.781222 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ab988450-73e0-4ae7-a693-73fce0de2828 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:50.781788 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ab988450-73e0-4ae7-a693-73fce0de2828 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:50.785535 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:50.785535 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:50.906763 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3031: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:50.906763 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context, Jul 13 02:32:50.914881 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3019: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:50.914881 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context, Jul 13 02:32:50.928447 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:4073: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:50.928447 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = model_query(context, models.InstanceAction).\ Jul 13 02:32:51.044059 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-c9f85bc9-801e-4299-8f46-7d9ee2df582b tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:51.044700 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-c9f85bc9-801e-4299-8f46-7d9ee2df582b tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d57716e0-3826-4e42-ad25-42cd46585692] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:51.051060 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c9f85bc9-801e-4299-8f46-7d9ee2df582b tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:51.051748 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c9f85bc9-801e-4299-8f46-7d9ee2df582b tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:51.052356 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c9f85bc9-801e-4299-8f46-7d9ee2df582b tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:51.052800 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c9f85bc9-801e-4299-8f46-7d9ee2df582b tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:51.056435 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:51.056435 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:51.082016 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/orm.py:29: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:51.082016 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return self.update({'deleted': entity.id, Jul 13 02:32:51.098942 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:4158: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:51.098942 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: event_ref = model_query(context, models.InstanceActionEvent).\ Jul 13 02:32:51.112287 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-ab988450-73e0-4ae7-a693-73fce0de2828 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "DELETE /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/os-volume_attachments/fbbf8018-f1be-4c1f-a49d-075280cbf518" status: 202 len: 0 microversion: 2.20 time: 0.343826 Jul 13 02:32:51.113239 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 417/865] 10.222.0.32 () {60 vars in 1457 bytes} [Tue Jul 13 02:32:50 2021] DELETE /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/os-volume_attachments/fbbf8018-f1be-4c1f-a49d-075280cbf518 => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 13 02:32:51.175849 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-69594793-de36-4b2e-8825-52ac38a9fc5e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:51.176430 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-69594793-de36-4b2e-8825-52ac38a9fc5e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:51.182353 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-69594793-de36-4b2e-8825-52ac38a9fc5e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:51.182809 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-69594793-de36-4b2e-8825-52ac38a9fc5e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:51.183627 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-69594793-de36-4b2e-8825-52ac38a9fc5e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:51.184067 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-69594793-de36-4b2e-8825-52ac38a9fc5e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:51.186905 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:51.186905 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:51.241497 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-c9f85bc9-801e-4299-8f46-7d9ee2df582b tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:51.244749 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:51.244749 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:51.252334 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-c9f85bc9-801e-4299-8f46-7d9ee2df582b tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/d57716e0-3826-4e42-ad25-42cd46585692" status: 200 len: 1264 microversion: 2.1 time: 0.211938 Jul 13 02:32:51.253607 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 449/866] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:32:51 2021] GET /compute/v2.1/servers/d57716e0-3826-4e42-ad25-42cd46585692 => generated 1264 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:32:51.262529 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-a96309ed-6f0a-432c-9ee1-9854e24561ba tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:51.262932 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:51.262932 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:51.263139 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-a96309ed-6f0a-432c-9ee1-9854e24561ba tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:51.265976 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a96309ed-6f0a-432c-9ee1-9854e24561ba tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:51.266555 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a96309ed-6f0a-432c-9ee1-9854e24561ba tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:51.267425 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a96309ed-6f0a-432c-9ee1-9854e24561ba tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:51.267929 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a96309ed-6f0a-432c-9ee1-9854e24561ba tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:51.270883 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:51.270883 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:51.319369 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/update_match.py:472: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:51.319369 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = query.session.execute(update_stmt) Jul 13 02:32:51.346555 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-69594793-de36-4b2e-8825-52ac38a9fc5e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action" status: 202 len: 0 microversion: 2.20 time: 0.174695 Jul 13 02:32:51.347156 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 418/867] 10.222.0.32 () {62 vars in 1319 bytes} [Tue Jul 13 02:32:51 2021] POST /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 13 02:32:51.354753 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-87fbe4b2-f7e5-48be-a10a-123338175435 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:51.355367 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-87fbe4b2-f7e5-48be-a10a-123338175435 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:51.361121 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-87fbe4b2-f7e5-48be-a10a-123338175435 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:51.361579 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-87fbe4b2-f7e5-48be-a10a-123338175435 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:51.362945 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-87fbe4b2-f7e5-48be-a10a-123338175435 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:51.363381 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-87fbe4b2-f7e5-48be-a10a-123338175435 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:51.366336 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:51.366336 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:51.404382 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-a96309ed-6f0a-432c-9ee1-9854e24561ba tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action" status: 200 len: 36264 microversion: 2.1 time: 0.149314 Jul 13 02:32:51.408397 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 450/868] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:32:51 2021] POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action => generated 36264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:32:51.549807 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-87fbe4b2-f7e5-48be-a10a-123338175435 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:51.552667 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:51.552667 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:51.559969 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-87fbe4b2-f7e5-48be-a10a-123338175435 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:51.561466 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-87fbe4b2-f7e5-48be-a10a-123338175435 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:51.562630 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-87fbe4b2-f7e5-48be-a10a-123338175435 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1672 microversion: 2.20 time: 0.211450 Jul 13 02:32:51.563180 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 419/869] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:32:51 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1672 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:32:52.270516 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-68e6cade-a9de-4447-8f1a-958d39ec2a54 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:52.271133 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-68e6cade-a9de-4447-8f1a-958d39ec2a54 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d57716e0-3826-4e42-ad25-42cd46585692] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:52.277544 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-68e6cade-a9de-4447-8f1a-958d39ec2a54 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:52.277991 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-68e6cade-a9de-4447-8f1a-958d39ec2a54 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:52.278799 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-68e6cade-a9de-4447-8f1a-958d39ec2a54 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:52.279232 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-68e6cade-a9de-4447-8f1a-958d39ec2a54 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:52.282231 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:52.282231 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:52.290227 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-40a39291-854b-4dcf-9f72-196f3bc6f592 req-c0c704f1-c2fe-4dd7-8591-b9cc35b19981 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcded031-14e6-4fa5-9a79-7e26c1aa0a0f", "name": "network-vif-unplugged", "status": "completed", "tag": "9e88c5ac-8fb9-44a9-a7fc-b323f20644f2"}, {"server_uuid": "bcded031-14e6-4fa5-9a79-7e26c1aa0a0f", "name": "network-vif-plugged", "status": "completed", "tag": "9e88c5ac-8fb9-44a9-a7fc-b323f20644f2"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:52.291866 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:32:52.291866 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:32:52.298537 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-40a39291-854b-4dcf-9f72-196f3bc6f592 req-c0c704f1-c2fe-4dd7-8591-b9cc35b19981 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:52.298972 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-40a39291-854b-4dcf-9f72-196f3bc6f592 req-c0c704f1-c2fe-4dd7-8591-b9cc35b19981 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:52.309887 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-40a39291-854b-4dcf-9f72-196f3bc6f592 req-c0c704f1-c2fe-4dd7-8591-b9cc35b19981 service nova] Creating event network-vif-unplugged:9e88c5ac-8fb9-44a9-a7fc-b323f20644f2 for instance bcded031-14e6-4fa5-9a79-7e26c1aa0a0f on hv-cinder-78102 Jul 13 02:32:52.310416 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-40a39291-854b-4dcf-9f72-196f3bc6f592 req-c0c704f1-c2fe-4dd7-8591-b9cc35b19981 service nova] Creating event network-vif-plugged:9e88c5ac-8fb9-44a9-a7fc-b323f20644f2 for instance bcded031-14e6-4fa5-9a79-7e26c1aa0a0f on hv-cinder-78102 Jul 13 02:32:52.316248 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-40a39291-854b-4dcf-9f72-196f3bc6f592 req-c0c704f1-c2fe-4dd7-8591-b9cc35b19981 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.028725 Jul 13 02:32:52.316865 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 420/870] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:32:52 2021] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:32:52.416048 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-9d5fe638-4eef-4aaa-85a4-3d9f0d149ce6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:52.417050 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-9d5fe638-4eef-4aaa-85a4-3d9f0d149ce6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:52.423121 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9d5fe638-4eef-4aaa-85a4-3d9f0d149ce6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:52.423564 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9d5fe638-4eef-4aaa-85a4-3d9f0d149ce6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:52.424354 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9d5fe638-4eef-4aaa-85a4-3d9f0d149ce6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:52.424897 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9d5fe638-4eef-4aaa-85a4-3d9f0d149ce6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:52.427653 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:52.427653 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:52.458252 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-68e6cade-a9de-4447-8f1a-958d39ec2a54 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:52.460821 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:52.460821 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:52.467956 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-68e6cade-a9de-4447-8f1a-958d39ec2a54 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/d57716e0-3826-4e42-ad25-42cd46585692" status: 200 len: 1451 microversion: 2.1 time: 0.202182 Jul 13 02:32:52.468537 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 451/871] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:32:52 2021] GET /compute/v2.1/servers/d57716e0-3826-4e42-ad25-42cd46585692 => generated 1451 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:32:52.483480 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-11d0744a-4352-4012-86e1-c6db2bb6ddc8 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:52.484162 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-11d0744a-4352-4012-86e1-c6db2bb6ddc8 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d57716e0-3826-4e42-ad25-42cd46585692] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:52.489974 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-11d0744a-4352-4012-86e1-c6db2bb6ddc8 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:52.490464 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-11d0744a-4352-4012-86e1-c6db2bb6ddc8 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:52.491247 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-11d0744a-4352-4012-86e1-c6db2bb6ddc8 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:52.491687 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-11d0744a-4352-4012-86e1-c6db2bb6ddc8 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:52.494752 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:52.494752 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:52.567064 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-9d5fe638-4eef-4aaa-85a4-3d9f0d149ce6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action" status: 200 len: 37424 microversion: 2.1 time: 0.154845 Jul 13 02:32:52.571091 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 421/872] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:32:52 2021] POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action => generated 37424 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 13 02:32:52.580850 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-e2ac2bdd-a93b-4484-8381-a2389cb1f2a2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:52.581794 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-e2ac2bdd-a93b-4484-8381-a2389cb1f2a2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:52.588778 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e2ac2bdd-a93b-4484-8381-a2389cb1f2a2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:52.589221 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e2ac2bdd-a93b-4484-8381-a2389cb1f2a2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:52.590037 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e2ac2bdd-a93b-4484-8381-a2389cb1f2a2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:52.590476 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e2ac2bdd-a93b-4484-8381-a2389cb1f2a2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:52.593418 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:52.593418 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:52.771101 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-11d0744a-4352-4012-86e1-c6db2bb6ddc8 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:52.773759 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:52.773759 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:52.780795 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-11d0744a-4352-4012-86e1-c6db2bb6ddc8 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/d57716e0-3826-4e42-ad25-42cd46585692" status: 200 len: 1451 microversion: 2.1 time: 0.300865 Jul 13 02:32:52.781645 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 452/873] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:32:52 2021] GET /compute/v2.1/servers/d57716e0-3826-4e42-ad25-42cd46585692 => generated 1451 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:32:52.915644 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-e2ac2bdd-a93b-4484-8381-a2389cb1f2a2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:52.918586 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:52.918586 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:52.926730 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-e2ac2bdd-a93b-4484-8381-a2389cb1f2a2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:52.928210 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-e2ac2bdd-a93b-4484-8381-a2389cb1f2a2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:52.929340 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-e2ac2bdd-a93b-4484-8381-a2389cb1f2a2 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1730 microversion: 2.20 time: 0.352557 Jul 13 02:32:52.930228 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 422/874] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:32:52 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1730 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:32:53.578868 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-f0dc2261-ce54-46fb-991d-57b17dc0abe8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:53.580432 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-f0dc2261-ce54-46fb-991d-57b17dc0abe8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:53.587333 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f0dc2261-ce54-46fb-991d-57b17dc0abe8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:53.587632 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f0dc2261-ce54-46fb-991d-57b17dc0abe8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:53.588602 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f0dc2261-ce54-46fb-991d-57b17dc0abe8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:53.589214 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f0dc2261-ce54-46fb-991d-57b17dc0abe8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:53.592139 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:53.592139 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:53.947411 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-a7e75caf-5b67-4efd-9d15-146d23774acb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:53.948371 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-a7e75caf-5b67-4efd-9d15-146d23774acb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:53.964923 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a7e75caf-5b67-4efd-9d15-146d23774acb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:53.965661 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a7e75caf-5b67-4efd-9d15-146d23774acb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:53.966796 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a7e75caf-5b67-4efd-9d15-146d23774acb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:53.967384 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a7e75caf-5b67-4efd-9d15-146d23774acb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:53.970686 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:53.970686 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:54.191971 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-a7e75caf-5b67-4efd-9d15-146d23774acb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:54.194892 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:54.194892 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:54.202631 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-a7e75caf-5b67-4efd-9d15-146d23774acb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:54.204352 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-a7e75caf-5b67-4efd-9d15-146d23774acb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:54.205776 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-a7e75caf-5b67-4efd-9d15-146d23774acb tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1730 microversion: 2.20 time: 0.261988 Jul 13 02:32:54.206667 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 423/875] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:32:53 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1730 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:32:54.335567 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-f0c10e83-ca98-4d21-81df-97458c097d8a req-fc240ba2-95be-4f3e-9fad-af93ea165f17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcded031-14e6-4fa5-9a79-7e26c1aa0a0f", "name": "network-vif-unplugged", "status": "completed", "tag": "9e88c5ac-8fb9-44a9-a7fc-b323f20644f2"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:54.337740 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:32:54.337740 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:32:54.350888 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-f0c10e83-ca98-4d21-81df-97458c097d8a req-fc240ba2-95be-4f3e-9fad-af93ea165f17 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:54.351460 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-f0c10e83-ca98-4d21-81df-97458c097d8a req-fc240ba2-95be-4f3e-9fad-af93ea165f17 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:54.370054 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-f0c10e83-ca98-4d21-81df-97458c097d8a req-fc240ba2-95be-4f3e-9fad-af93ea165f17 service nova] Creating event network-vif-unplugged:9e88c5ac-8fb9-44a9-a7fc-b323f20644f2 for instance bcded031-14e6-4fa5-9a79-7e26c1aa0a0f on hv-cinder-78102 Jul 13 02:32:54.382596 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-f0c10e83-ca98-4d21-81df-97458c097d8a req-fc240ba2-95be-4f3e-9fad-af93ea165f17 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053243 Jul 13 02:32:54.383681 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 424/876] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:32:54 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 02:32:54.742099 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-297c734f-35c2-4f79-af5e-339c30d72d63 req-ef453fb0-c58a-4db6-a429-599d4e2010e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d57716e0-3826-4e42-ad25-42cd46585692", "tag": "a5ebc0a6-1594-4ae0-8308-07615056f845"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:54.743610 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:32:54.743610 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:32:54.750644 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-297c734f-35c2-4f79-af5e-339c30d72d63 req-ef453fb0-c58a-4db6-a429-599d4e2010e2 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:54.751095 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-297c734f-35c2-4f79-af5e-339c30d72d63 req-ef453fb0-c58a-4db6-a429-599d4e2010e2 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:54.764124 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-297c734f-35c2-4f79-af5e-339c30d72d63 req-ef453fb0-c58a-4db6-a429-599d4e2010e2 service nova] Creating event network-changed:a5ebc0a6-1594-4ae0-8308-07615056f845 for instance d57716e0-3826-4e42-ad25-42cd46585692 on hv-cinder-78102 Jul 13 02:32:54.771370 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-297c734f-35c2-4f79-af5e-339c30d72d63 req-ef453fb0-c58a-4db6-a429-599d4e2010e2 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091677 Jul 13 02:32:54.772028 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 425/877] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:32:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 02:32:55.225286 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-82b3a8ee-6a32-420f-8d3a-e504e45eecdf tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:55.226900 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-82b3a8ee-6a32-420f-8d3a-e504e45eecdf tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:55.233243 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-82b3a8ee-6a32-420f-8d3a-e504e45eecdf tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:55.233689 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-82b3a8ee-6a32-420f-8d3a-e504e45eecdf tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:55.234486 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-82b3a8ee-6a32-420f-8d3a-e504e45eecdf tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:55.234920 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-82b3a8ee-6a32-420f-8d3a-e504e45eecdf tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:55.238093 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:55.238093 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:55.477959 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-82b3a8ee-6a32-420f-8d3a-e504e45eecdf tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:55.480791 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:55.480791 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:55.489998 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-82b3a8ee-6a32-420f-8d3a-e504e45eecdf tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:55.491786 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-82b3a8ee-6a32-420f-8d3a-e504e45eecdf tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:55.493048 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-82b3a8ee-6a32-420f-8d3a-e504e45eecdf tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1730 microversion: 2.20 time: 0.272370 Jul 13 02:32:55.494510 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 426/878] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:32:55 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1730 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:32:55.675189 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-118dadf8-af18-46dd-adbf-211063344667 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:55.676254 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-118dadf8-af18-46dd-adbf-211063344667 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:55.682114 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-118dadf8-af18-46dd-adbf-211063344667 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:55.682501 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-118dadf8-af18-46dd-adbf-211063344667 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:55.683264 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-118dadf8-af18-46dd-adbf-211063344667 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:55.683684 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-118dadf8-af18-46dd-adbf-211063344667 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:55.686575 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:55.686575 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:55.773819 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:55.773819 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:55.834692 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/update_match.py:472: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:55.834692 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = query.session.execute(update_stmt) Jul 13 02:32:55.859678 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-118dadf8-af18-46dd-adbf-211063344667 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "POST /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525/action" status: 202 len: 0 microversion: 2.1 time: 0.188241 Jul 13 02:32:55.862251 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 427/879] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:32:55 2021] POST /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 13 02:32:55.870128 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-ff27e2cd-d67e-4ec2-9352-6e33a7462a2b tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:55.871110 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-ff27e2cd-d67e-4ec2-9352-6e33a7462a2b tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:55.877997 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ff27e2cd-d67e-4ec2-9352-6e33a7462a2b tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:55.879011 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ff27e2cd-d67e-4ec2-9352-6e33a7462a2b tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:55.879790 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ff27e2cd-d67e-4ec2-9352-6e33a7462a2b tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:55.880229 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ff27e2cd-d67e-4ec2-9352-6e33a7462a2b tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:55.883490 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:55.883490 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:56.101293 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-ff27e2cd-d67e-4ec2-9352-6e33a7462a2b tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:56.104099 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:56.104099 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:56.113330 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-ff27e2cd-d67e-4ec2-9352-6e33a7462a2b tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1750 microversion: 2.1 time: 0.247277 Jul 13 02:32:56.125482 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 428/880] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:32:55 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1750 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:32:56.398012 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-65f71229-52a3-4c56-958a-433ffa98293a req-8d8758f9-dc14-4ab1-a8b3-f362cbcf5195 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcded031-14e6-4fa5-9a79-7e26c1aa0a0f", "name": "network-vif-plugged", "status": "completed", "tag": "9e88c5ac-8fb9-44a9-a7fc-b323f20644f2"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:32:56.399561 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:32:56.399561 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:32:56.406667 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-65f71229-52a3-4c56-958a-433ffa98293a req-8d8758f9-dc14-4ab1-a8b3-f362cbcf5195 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:56.407099 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-65f71229-52a3-4c56-958a-433ffa98293a req-8d8758f9-dc14-4ab1-a8b3-f362cbcf5195 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:56.418933 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-65f71229-52a3-4c56-958a-433ffa98293a req-8d8758f9-dc14-4ab1-a8b3-f362cbcf5195 service nova] Creating event network-vif-plugged:9e88c5ac-8fb9-44a9-a7fc-b323f20644f2 for instance bcded031-14e6-4fa5-9a79-7e26c1aa0a0f on hv-cinder-78102 Jul 13 02:32:56.423935 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-65f71229-52a3-4c56-958a-433ffa98293a req-8d8758f9-dc14-4ab1-a8b3-f362cbcf5195 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029877 Jul 13 02:32:56.425498 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 429/881] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:32:56 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 02:32:56.512602 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-1ed3dd10-89e7-4f43-900e-8d82744a942d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:56.513744 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-1ed3dd10-89e7-4f43-900e-8d82744a942d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:56.520958 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1ed3dd10-89e7-4f43-900e-8d82744a942d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:56.521493 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1ed3dd10-89e7-4f43-900e-8d82744a942d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:56.522395 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1ed3dd10-89e7-4f43-900e-8d82744a942d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:56.522902 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1ed3dd10-89e7-4f43-900e-8d82744a942d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:56.525988 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:56.525988 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:56.708493 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-1ed3dd10-89e7-4f43-900e-8d82744a942d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:56.711474 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:56.711474 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:56.719190 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-1ed3dd10-89e7-4f43-900e-8d82744a942d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:56.720840 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-1ed3dd10-89e7-4f43-900e-8d82744a942d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:56.722595 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-1ed3dd10-89e7-4f43-900e-8d82744a942d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1730 microversion: 2.20 time: 0.214198 Jul 13 02:32:56.723149 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 430/882] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:32:56 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1730 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:32:57.130175 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-277ad140-6c89-4c44-aa01-0a6128d24970 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:57.130788 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-277ad140-6c89-4c44-aa01-0a6128d24970 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:57.136914 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-277ad140-6c89-4c44-aa01-0a6128d24970 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:57.137633 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-277ad140-6c89-4c44-aa01-0a6128d24970 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:57.138819 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-277ad140-6c89-4c44-aa01-0a6128d24970 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:57.139321 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-277ad140-6c89-4c44-aa01-0a6128d24970 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:57.142621 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:57.142621 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:57.320394 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-277ad140-6c89-4c44-aa01-0a6128d24970 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:57.323166 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:57.323166 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:57.330713 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-277ad140-6c89-4c44-aa01-0a6128d24970 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1750 microversion: 2.1 time: 0.204398 Jul 13 02:32:57.331437 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 431/883] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:32:57 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1750 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:32:57.740791 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-b14e6ba1-ff79-4a63-bf61-ce1fe342be5d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:57.741516 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-b14e6ba1-ff79-4a63-bf61-ce1fe342be5d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:57.747239 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b14e6ba1-ff79-4a63-bf61-ce1fe342be5d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:57.747684 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b14e6ba1-ff79-4a63-bf61-ce1fe342be5d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:57.748477 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b14e6ba1-ff79-4a63-bf61-ce1fe342be5d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:57.748893 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b14e6ba1-ff79-4a63-bf61-ce1fe342be5d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:57.751864 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:57.751864 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:57.938366 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-b14e6ba1-ff79-4a63-bf61-ce1fe342be5d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:57.941520 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:57.941520 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:57.949097 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-b14e6ba1-ff79-4a63-bf61-ce1fe342be5d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:57.953703 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-b14e6ba1-ff79-4a63-bf61-ce1fe342be5d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:57.953703 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-b14e6ba1-ff79-4a63-bf61-ce1fe342be5d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1730 microversion: 2.20 time: 0.214909 Jul 13 02:32:57.963270 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 432/884] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:32:57 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1730 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:32:58.350069 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-7cc24130-ef44-45b4-89e8-c9f3dfaf6b53 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:58.350611 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-7cc24130-ef44-45b4-89e8-c9f3dfaf6b53 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:58.356846 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7cc24130-ef44-45b4-89e8-c9f3dfaf6b53 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:58.357251 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7cc24130-ef44-45b4-89e8-c9f3dfaf6b53 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:58.358043 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7cc24130-ef44-45b4-89e8-c9f3dfaf6b53 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:58.358484 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7cc24130-ef44-45b4-89e8-c9f3dfaf6b53 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:58.362336 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:58.362336 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:58.546338 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-7cc24130-ef44-45b4-89e8-c9f3dfaf6b53 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:58.548923 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:58.548923 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:58.556841 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-7cc24130-ef44-45b4-89e8-c9f3dfaf6b53 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1750 microversion: 2.1 time: 0.211479 Jul 13 02:32:58.557416 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 433/885] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:32:58 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1750 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:32:58.970866 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-7b12d7dc-a7d8-49c8-976f-f38464225d8e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:58.971810 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-7b12d7dc-a7d8-49c8-976f-f38464225d8e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:58.980200 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7b12d7dc-a7d8-49c8-976f-f38464225d8e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:58.984839 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7b12d7dc-a7d8-49c8-976f-f38464225d8e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:58.984839 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7b12d7dc-a7d8-49c8-976f-f38464225d8e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:58.984839 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7b12d7dc-a7d8-49c8-976f-f38464225d8e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:58.985587 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:58.985587 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:59.171133 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-7b12d7dc-a7d8-49c8-976f-f38464225d8e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:59.173804 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:59.173804 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:59.182605 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-7b12d7dc-a7d8-49c8-976f-f38464225d8e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:59.184103 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-7b12d7dc-a7d8-49c8-976f-f38464225d8e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:59.185267 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-7b12d7dc-a7d8-49c8-976f-f38464225d8e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1730 microversion: 2.20 time: 0.218246 Jul 13 02:32:59.185828 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 434/886] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:32:58 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1730 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:32:59.574358 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-152b5ce1-81f6-4dc1-bc60-c66616be1c31 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:32:59.575218 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-152b5ce1-81f6-4dc1-bc60-c66616be1c31 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:32:59.581909 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-152b5ce1-81f6-4dc1-bc60-c66616be1c31 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:59.582610 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-152b5ce1-81f6-4dc1-bc60-c66616be1c31 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:59.583380 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-152b5ce1-81f6-4dc1-bc60-c66616be1c31 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:32:59.583814 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-152b5ce1-81f6-4dc1-bc60-c66616be1c31 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:32:59.586795 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:59.586795 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:32:59.780052 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-152b5ce1-81f6-4dc1-bc60-c66616be1c31 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:32:59.782781 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:32:59.782781 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:32:59.790849 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-152b5ce1-81f6-4dc1-bc60-c66616be1c31 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1750 microversion: 2.1 time: 0.220326 Jul 13 02:32:59.791434 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 435/887] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:32:59 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1750 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:33:00.203542 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-9acde6f5-68cd-4317-bf23-f5e290461aa4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:00.204248 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-9acde6f5-68cd-4317-bf23-f5e290461aa4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:00.211297 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9acde6f5-68cd-4317-bf23-f5e290461aa4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:00.211748 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9acde6f5-68cd-4317-bf23-f5e290461aa4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:00.212758 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9acde6f5-68cd-4317-bf23-f5e290461aa4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:00.213277 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9acde6f5-68cd-4317-bf23-f5e290461aa4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:00.217199 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:00.217199 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:00.401604 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-9acde6f5-68cd-4317-bf23-f5e290461aa4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:00.404240 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:00.404240 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:33:00.412547 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-9acde6f5-68cd-4317-bf23-f5e290461aa4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:00.414074 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-9acde6f5-68cd-4317-bf23-f5e290461aa4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:00.415236 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-9acde6f5-68cd-4317-bf23-f5e290461aa4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1730 microversion: 2.20 time: 0.215439 Jul 13 02:33:00.416062 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 436/888] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:33:00 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1730 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:33:00.808458 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-fc8a6859-febd-471f-80fb-2b6a97de369c tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:00.809073 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-fc8a6859-febd-471f-80fb-2b6a97de369c tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:00.815691 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-fc8a6859-febd-471f-80fb-2b6a97de369c tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:00.816137 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-fc8a6859-febd-471f-80fb-2b6a97de369c tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:00.816903 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-fc8a6859-febd-471f-80fb-2b6a97de369c tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:00.817349 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-fc8a6859-febd-471f-80fb-2b6a97de369c tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:00.820215 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:00.820215 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:01.006407 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-fc8a6859-febd-471f-80fb-2b6a97de369c tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:01.008997 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:01.008997 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:33:01.017508 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-fc8a6859-febd-471f-80fb-2b6a97de369c tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1750 microversion: 2.1 time: 0.212657 Jul 13 02:33:01.026299 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 437/889] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:33:00 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1750 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:33:01.433372 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-08673df6-51eb-422a-889e-23f8a6022ebe tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:01.434132 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-08673df6-51eb-422a-889e-23f8a6022ebe tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:01.441045 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-08673df6-51eb-422a-889e-23f8a6022ebe tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:01.441488 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-08673df6-51eb-422a-889e-23f8a6022ebe tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:01.442319 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-08673df6-51eb-422a-889e-23f8a6022ebe tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:01.442812 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-08673df6-51eb-422a-889e-23f8a6022ebe tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:01.446102 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:01.446102 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:01.637049 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-08673df6-51eb-422a-889e-23f8a6022ebe tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:01.640290 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:01.640290 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:33:01.647992 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-08673df6-51eb-422a-889e-23f8a6022ebe tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:01.649463 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-08673df6-51eb-422a-889e-23f8a6022ebe tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:01.650619 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-08673df6-51eb-422a-889e-23f8a6022ebe tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1730 microversion: 2.20 time: 0.221088 Jul 13 02:33:01.651170 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 438/890] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:33:01 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1730 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:33:02.034294 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-2be0f84a-afe6-4af8-bb9e-76df14364144 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:02.034911 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-2be0f84a-afe6-4af8-bb9e-76df14364144 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:02.040706 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2be0f84a-afe6-4af8-bb9e-76df14364144 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:02.041151 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2be0f84a-afe6-4af8-bb9e-76df14364144 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:02.041912 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2be0f84a-afe6-4af8-bb9e-76df14364144 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:02.042368 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2be0f84a-afe6-4af8-bb9e-76df14364144 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:02.045185 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:02.045185 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:02.229708 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-2be0f84a-afe6-4af8-bb9e-76df14364144 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:02.232792 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:02.232792 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:33:02.241368 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-2be0f84a-afe6-4af8-bb9e-76df14364144 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1750 microversion: 2.1 time: 0.210787 Jul 13 02:33:02.242058 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 439/891] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:33:02 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1750 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:33:02.669927 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-67e4f76e-cfa8-47c3-9a72-6121ca4994d4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:02.670738 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-67e4f76e-cfa8-47c3-9a72-6121ca4994d4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:02.676832 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-67e4f76e-cfa8-47c3-9a72-6121ca4994d4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:02.677375 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-67e4f76e-cfa8-47c3-9a72-6121ca4994d4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:02.678286 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-67e4f76e-cfa8-47c3-9a72-6121ca4994d4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:02.678728 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-67e4f76e-cfa8-47c3-9a72-6121ca4994d4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:02.689085 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:02.689085 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:02.885131 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-67e4f76e-cfa8-47c3-9a72-6121ca4994d4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:02.888005 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:02.888005 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:33:02.896548 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-67e4f76e-cfa8-47c3-9a72-6121ca4994d4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:02.898044 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-67e4f76e-cfa8-47c3-9a72-6121ca4994d4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:02.899171 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-67e4f76e-cfa8-47c3-9a72-6121ca4994d4 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1730 microversion: 2.20 time: 0.232999 Jul 13 02:33:02.899754 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 440/892] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:33:02 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1730 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:33:03.259687 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-f3091a11-392d-41fa-bfad-071fdc816776 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:03.260297 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-f3091a11-392d-41fa-bfad-071fdc816776 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:03.266955 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f3091a11-392d-41fa-bfad-071fdc816776 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:03.267400 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f3091a11-392d-41fa-bfad-071fdc816776 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:03.268357 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f3091a11-392d-41fa-bfad-071fdc816776 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:03.268896 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f3091a11-392d-41fa-bfad-071fdc816776 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:03.272104 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:03.272104 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:03.452631 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-f3091a11-392d-41fa-bfad-071fdc816776 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:03.455498 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:03.455498 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:33:03.463031 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-f3091a11-392d-41fa-bfad-071fdc816776 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1750 microversion: 2.1 time: 0.207213 Jul 13 02:33:03.463591 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 441/893] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:33:03 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1750 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:33:03.917637 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-6bb56562-9eeb-49b9-81f8-b5704bf45d50 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:03.918351 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-6bb56562-9eeb-49b9-81f8-b5704bf45d50 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:03.924071 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-6bb56562-9eeb-49b9-81f8-b5704bf45d50 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:03.925061 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-6bb56562-9eeb-49b9-81f8-b5704bf45d50 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:03.925840 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-6bb56562-9eeb-49b9-81f8-b5704bf45d50 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:03.926303 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-6bb56562-9eeb-49b9-81f8-b5704bf45d50 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:03.929089 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:03.929089 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:04.105238 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-6bb56562-9eeb-49b9-81f8-b5704bf45d50 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:04.107827 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:04.107827 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:33:04.115406 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-6bb56562-9eeb-49b9-81f8-b5704bf45d50 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:04.116903 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-6bb56562-9eeb-49b9-81f8-b5704bf45d50 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:04.118089 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-6bb56562-9eeb-49b9-81f8-b5704bf45d50 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1730 microversion: 2.20 time: 0.204201 Jul 13 02:33:04.118858 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 442/894] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:33:03 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1730 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 13 02:33:04.139804 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-f0dc2261-ce54-46fb-991d-57b17dc0abe8 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action" status: 200 len: 38339 microversion: 2.1 time: 10.565001 Jul 13 02:33:04.145947 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 453/895] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:32:53 2021] POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/action => generated 38339 bytes in 10567 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 13 02:33:04.151053 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-c41f10d3-8f67-498f-b915-cea1e09bc71e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:04.151553 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-c41f10d3-8f67-498f-b915-cea1e09bc71e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:04.159711 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c41f10d3-8f67-498f-b915-cea1e09bc71e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:04.159711 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c41f10d3-8f67-498f-b915-cea1e09bc71e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:04.159711 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c41f10d3-8f67-498f-b915-cea1e09bc71e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:04.161424 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c41f10d3-8f67-498f-b915-cea1e09bc71e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:04.163477 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:04.163477 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:04.223573 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-c41f10d3-8f67-498f-b915-cea1e09bc71e tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/ips" status: 200 len: 145 microversion: 2.1 time: 0.076124 Jul 13 02:33:04.229361 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 443/896] 10.222.0.32 () {58 vars in 1248 bytes} [Tue Jul 13 02:33:04 2021] GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/ips => generated 145 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:33:04.480530 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-1e08df69-78e8-40ae-bc21-dcc203d989e3 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:04.482133 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-1e08df69-78e8-40ae-bc21-dcc203d989e3 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:04.489760 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-1e08df69-78e8-40ae-bc21-dcc203d989e3 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:04.490431 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-1e08df69-78e8-40ae-bc21-dcc203d989e3 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:04.491562 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-1e08df69-78e8-40ae-bc21-dcc203d989e3 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:04.492194 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-1e08df69-78e8-40ae-bc21-dcc203d989e3 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:04.495522 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:04.495522 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:04.997451 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-1e08df69-78e8-40ae-bc21-dcc203d989e3 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:05.000222 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:05.000222 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:33:05.009321 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-1e08df69-78e8-40ae-bc21-dcc203d989e3 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1750 microversion: 2.1 time: 0.532676 Jul 13 02:33:05.010504 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 454/897] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:33:04 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1750 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:33:05.136964 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-69c52083-6c31-4576-b304-f8119b34ca3d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:05.137572 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-69c52083-6c31-4576-b304-f8119b34ca3d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:05.144931 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-69c52083-6c31-4576-b304-f8119b34ca3d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:05.145379 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-69c52083-6c31-4576-b304-f8119b34ca3d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:05.146181 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-69c52083-6c31-4576-b304-f8119b34ca3d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:05.146615 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-69c52083-6c31-4576-b304-f8119b34ca3d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:05.149521 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:05.149521 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:05.348782 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-69c52083-6c31-4576-b304-f8119b34ca3d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:05.351360 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:05.351360 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:33:05.358543 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-69c52083-6c31-4576-b304-f8119b34ca3d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:05.360134 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-69c52083-6c31-4576-b304-f8119b34ca3d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:05.361156 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-69c52083-6c31-4576-b304-f8119b34ca3d tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1730 microversion: 2.20 time: 0.228153 Jul 13 02:33:05.361726 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 444/898] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:33:05 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1730 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:33:05.548205 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-a6466488-f422-4707-b2dd-c25a32c9589d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fba5651a-0388-4e8c-a888-ddbaba45e031"}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:33:05.549916 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-a6466488-f422-4707-b2dd-c25a32c9589d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:05.556114 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a6466488-f422-4707-b2dd-c25a32c9589d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:05.556562 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a6466488-f422-4707-b2dd-c25a32c9589d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:05.557323 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a6466488-f422-4707-b2dd-c25a32c9589d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:05.557756 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-a6466488-f422-4707-b2dd-c25a32c9589d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:05.560452 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:05.560452 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:05.669204 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3019: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:05.669204 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context, Jul 13 02:33:05.767399 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2940: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:05.767399 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: query.update(values) Jul 13 02:33:05.769993 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2941: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:05.769993 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return query.first() Jul 13 02:33:05.856209 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2940: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:05.856209 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: query.update(values) Jul 13 02:33:05.858418 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2941: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:05.858418 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return query.first() Jul 13 02:33:05.876815 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-a6466488-f422-4707-b2dd-c25a32c9589d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.332201 Jul 13 02:33:05.877448 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 455/899] 10.222.0.32 () {60 vars in 1323 bytes} [Tue Jul 13 02:33:05 2021] POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/os-volume_attachments => generated 194 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:33:06.027672 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-84109db6-4f58-42e6-98d4-1d0f176b116f tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:06.028266 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-84109db6-4f58-42e6-98d4-1d0f176b116f tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:06.034707 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-84109db6-4f58-42e6-98d4-1d0f176b116f tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:06.035139 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-84109db6-4f58-42e6-98d4-1d0f176b116f tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:06.035894 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-84109db6-4f58-42e6-98d4-1d0f176b116f tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:06.036318 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-84109db6-4f58-42e6-98d4-1d0f176b116f tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:06.039115 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:06.039115 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:06.210219 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-84109db6-4f58-42e6-98d4-1d0f176b116f tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:06.212771 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:06.212771 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:33:06.220024 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-84109db6-4f58-42e6-98d4-1d0f176b116f tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1755 microversion: 2.1 time: 0.196202 Jul 13 02:33:06.220613 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 445/900] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:33:06 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1755 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:33:06.378992 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-38b9f71f-7fd5-4ca1-af8f-0dac12e50283 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:06.379598 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-38b9f71f-7fd5-4ca1-af8f-0dac12e50283 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:06.386339 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-38b9f71f-7fd5-4ca1-af8f-0dac12e50283 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:06.386792 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-38b9f71f-7fd5-4ca1-af8f-0dac12e50283 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:06.387559 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-38b9f71f-7fd5-4ca1-af8f-0dac12e50283 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:06.388251 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-38b9f71f-7fd5-4ca1-af8f-0dac12e50283 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:06.391154 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:06.391154 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:06.563826 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-38b9f71f-7fd5-4ca1-af8f-0dac12e50283 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:06.567480 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:06.567480 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:33:06.575009 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-38b9f71f-7fd5-4ca1-af8f-0dac12e50283 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:06.576529 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-38b9f71f-7fd5-4ca1-af8f-0dac12e50283 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:06.577660 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-38b9f71f-7fd5-4ca1-af8f-0dac12e50283 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1730 microversion: 2.20 time: 0.202881 Jul 13 02:33:06.578222 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 456/901] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:33:06 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1730 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:33:07.238361 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-ed3b5edb-9be0-4b25-8671-1543ccf06ac0 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:07.238956 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-ed3b5edb-9be0-4b25-8671-1543ccf06ac0 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:07.244714 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ed3b5edb-9be0-4b25-8671-1543ccf06ac0 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:07.245164 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ed3b5edb-9be0-4b25-8671-1543ccf06ac0 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:07.245929 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ed3b5edb-9be0-4b25-8671-1543ccf06ac0 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:07.246387 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ed3b5edb-9be0-4b25-8671-1543ccf06ac0 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:07.249205 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:07.249205 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:07.422347 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-ed3b5edb-9be0-4b25-8671-1543ccf06ac0 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:07.425511 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:07.425511 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:33:07.432782 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-ed3b5edb-9be0-4b25-8671-1543ccf06ac0 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1755 microversion: 2.1 time: 0.198812 Jul 13 02:33:07.433338 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 446/902] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:33:07 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1755 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:33:07.597222 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-1645ee82-073c-4485-967d-706acb33f53e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:07.597738 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-1645ee82-073c-4485-967d-706acb33f53e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:07.604060 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-1645ee82-073c-4485-967d-706acb33f53e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:07.604502 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-1645ee82-073c-4485-967d-706acb33f53e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:07.605256 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-1645ee82-073c-4485-967d-706acb33f53e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:07.605687 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-1645ee82-073c-4485-967d-706acb33f53e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:07.608522 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:07.608522 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:07.839943 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-1645ee82-073c-4485-967d-706acb33f53e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:07.842540 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:07.842540 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:33:07.850797 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-1645ee82-073c-4485-967d-706acb33f53e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:07.852289 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-1645ee82-073c-4485-967d-706acb33f53e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:07.853432 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-1645ee82-073c-4485-967d-706acb33f53e tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1717 microversion: 2.20 time: 0.260844 Jul 13 02:33:07.853981 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 457/903] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:33:07 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1717 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:33:08.449689 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-cfa7d655-d69b-471d-a805-74e049f760f1 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:08.450357 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-cfa7d655-d69b-471d-a805-74e049f760f1 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:08.457508 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-cfa7d655-d69b-471d-a805-74e049f760f1 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:08.457955 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-cfa7d655-d69b-471d-a805-74e049f760f1 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:08.458770 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-cfa7d655-d69b-471d-a805-74e049f760f1 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:08.459207 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-cfa7d655-d69b-471d-a805-74e049f760f1 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:08.462511 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:08.462511 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:08.638452 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-cfa7d655-d69b-471d-a805-74e049f760f1 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:08.640970 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:08.640970 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:33:08.650050 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-cfa7d655-d69b-471d-a805-74e049f760f1 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1755 microversion: 2.1 time: 0.203959 Jul 13 02:33:08.650637 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 447/904] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:33:08 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1755 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:33:08.771023 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [req-1013133b-794e-44da-9071-fc28ed06d7da req-d8d559ac-9ea1-48d6-a03f-23fda3998f33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcded031-14e6-4fa5-9a79-7e26c1aa0a0f", "name": "network-vif-plugged", "status": "completed", "tag": "9e88c5ac-8fb9-44a9-a7fc-b323f20644f2"}]} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:33:08.772684 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:33:08.772684 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: warnings.warn(msg) Jul 13 02:33:08.781067 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-1013133b-794e-44da-9071-fc28ed06d7da req-d8d559ac-9ea1-48d6-a03f-23fda3998f33 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:08.781514 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-1013133b-794e-44da-9071-fc28ed06d7da req-d8d559ac-9ea1-48d6-a03f-23fda3998f33 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:08.793043 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.compute.server_external_events [req-1013133b-794e-44da-9071-fc28ed06d7da req-d8d559ac-9ea1-48d6-a03f-23fda3998f33 service nova] Creating event network-vif-plugged:9e88c5ac-8fb9-44a9-a7fc-b323f20644f2 for instance bcded031-14e6-4fa5-9a79-7e26c1aa0a0f on hv-cinder-78102 Jul 13 02:33:08.797980 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [req-1013133b-794e-44da-9071-fc28ed06d7da req-d8d559ac-9ea1-48d6-a03f-23fda3998f33 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031134 Jul 13 02:33:08.798595 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 458/905] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:33:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 02:33:09.667827 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-76b9b132-4d6d-4efe-8f07-4588e0d5e851 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:09.668375 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-76b9b132-4d6d-4efe-8f07-4588e0d5e851 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:09.674153 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-76b9b132-4d6d-4efe-8f07-4588e0d5e851 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:09.674623 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-76b9b132-4d6d-4efe-8f07-4588e0d5e851 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:09.675377 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-76b9b132-4d6d-4efe-8f07-4588e0d5e851 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:09.675804 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-76b9b132-4d6d-4efe-8f07-4588e0d5e851 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:09.678607 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:09.678607 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:09.854198 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-76b9b132-4d6d-4efe-8f07-4588e0d5e851 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:09.856722 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:09.856722 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:33:09.864135 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-76b9b132-4d6d-4efe-8f07-4588e0d5e851 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1755 microversion: 2.1 time: 0.200037 Jul 13 02:33:09.864702 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 448/906] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:33:09 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1755 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:33:10.882266 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-189dc07e-1638-453c-b660-c6853062a2cd tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:10.882958 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-189dc07e-1638-453c-b660-c6853062a2cd tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:10.889599 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-189dc07e-1638-453c-b660-c6853062a2cd tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:10.890051 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-189dc07e-1638-453c-b660-c6853062a2cd tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:10.890813 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-189dc07e-1638-453c-b660-c6853062a2cd tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:10.891242 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-189dc07e-1638-453c-b660-c6853062a2cd tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:10.894965 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:10.894965 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:11.067905 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-189dc07e-1638-453c-b660-c6853062a2cd tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:11.070498 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:11.070498 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:33:11.077780 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-189dc07e-1638-453c-b660-c6853062a2cd tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1755 microversion: 2.1 time: 0.199521 Jul 13 02:33:11.078381 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 459/907] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:33:10 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1755 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:33:12.094487 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-565f460a-d8bb-4b1e-bc53-1e927de75340 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:12.095193 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-565f460a-d8bb-4b1e-bc53-1e927de75340 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:12.101826 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-565f460a-d8bb-4b1e-bc53-1e927de75340 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:12.102297 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-565f460a-d8bb-4b1e-bc53-1e927de75340 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:12.103053 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-565f460a-d8bb-4b1e-bc53-1e927de75340 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:12.103479 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-565f460a-d8bb-4b1e-bc53-1e927de75340 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:12.106296 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:12.106296 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:12.282551 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-565f460a-d8bb-4b1e-bc53-1e927de75340 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:12.286012 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:12.286012 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:33:12.293694 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-565f460a-d8bb-4b1e-bc53-1e927de75340 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1755 microversion: 2.1 time: 0.202838 Jul 13 02:33:12.294300 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 449/908] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:33:12 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1755 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:33:13.310745 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-5a6e5bcb-339d-41e2-a5bd-a47acd047a29 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:13.311365 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-5a6e5bcb-339d-41e2-a5bd-a47acd047a29 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:13.318012 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5a6e5bcb-339d-41e2-a5bd-a47acd047a29 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:13.318497 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5a6e5bcb-339d-41e2-a5bd-a47acd047a29 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:13.319269 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5a6e5bcb-339d-41e2-a5bd-a47acd047a29 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:13.319706 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5a6e5bcb-339d-41e2-a5bd-a47acd047a29 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:13.322603 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:13.322603 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:13.337611 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-32590c34-9a55-47ce-8240-32461e34f26a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:13.338580 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-32590c34-9a55-47ce-8240-32461e34f26a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:13.344518 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-32590c34-9a55-47ce-8240-32461e34f26a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:13.344992 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-32590c34-9a55-47ce-8240-32461e34f26a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:13.346427 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-32590c34-9a55-47ce-8240-32461e34f26a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:13.346922 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-32590c34-9a55-47ce-8240-32461e34f26a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:13.349676 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:13.349676 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:13.410826 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3008: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:13.410826 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).\ Jul 13 02:33:13.417881 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-32590c34-9a55-47ce-8240-32461e34f26a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.084044 Jul 13 02:33:13.418466 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 450/909] 10.222.0.32 () {58 vars in 1302 bytes} [Tue Jul 13 02:33:13 2021] GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 02:33:13.428215 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-987554cb-4864-4ba2-ac02-5e7ab311bc46 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:13.428701 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-987554cb-4864-4ba2-ac02-5e7ab311bc46 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:13.434223 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-987554cb-4864-4ba2-ac02-5e7ab311bc46 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:13.434676 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-987554cb-4864-4ba2-ac02-5e7ab311bc46 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:13.435439 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-987554cb-4864-4ba2-ac02-5e7ab311bc46 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:13.435875 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-987554cb-4864-4ba2-ac02-5e7ab311bc46 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:13.438528 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:13.438528 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:13.498465 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3031: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:13.498465 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context, Jul 13 02:33:13.503589 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-5a6e5bcb-339d-41e2-a5bd-a47acd047a29 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:13.505289 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-987554cb-4864-4ba2-ac02-5e7ab311bc46 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/os-volume_attachments/fba5651a-0388-4e8c-a888-ddbaba45e031" status: 200 len: 194 microversion: 2.1 time: 0.081041 Jul 13 02:33:13.505898 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 451/910] 10.222.0.32 () {58 vars in 1413 bytes} [Tue Jul 13 02:33:13 2021] GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/os-volume_attachments/fba5651a-0388-4e8c-a888-ddbaba45e031 => generated 194 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 02:33:13.506178 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:13.506178 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:33:13.514159 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-5a6e5bcb-339d-41e2-a5bd-a47acd047a29 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1755 microversion: 2.1 time: 0.207037 Jul 13 02:33:13.514721 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 460/911] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:33:13 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1755 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:33:14.531115 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-f63d58e5-7356-4ffa-979f-93fb14e2fc43 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:14.531666 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-f63d58e5-7356-4ffa-979f-93fb14e2fc43 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:14.537699 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f63d58e5-7356-4ffa-979f-93fb14e2fc43 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:14.538175 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f63d58e5-7356-4ffa-979f-93fb14e2fc43 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:14.538939 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f63d58e5-7356-4ffa-979f-93fb14e2fc43 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:14.539372 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f63d58e5-7356-4ffa-979f-93fb14e2fc43 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:14.542199 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:14.542199 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:14.714957 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-f63d58e5-7356-4ffa-979f-93fb14e2fc43 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:14.717470 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:14.717470 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:33:14.724743 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-f63d58e5-7356-4ffa-979f-93fb14e2fc43 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1755 microversion: 2.1 time: 0.197515 Jul 13 02:33:14.725311 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 452/912] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:33:14 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1755 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:33:14.815578 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-7f033e6a-30a6-4d39-8829-eeaf75b44ad9 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cbcd07f2-cdfd-454e-addb-0eaaacefc910"}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:33:14.816636 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-7f033e6a-30a6-4d39-8829-eeaf75b44ad9 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:14.822361 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7f033e6a-30a6-4d39-8829-eeaf75b44ad9 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:14.822812 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7f033e6a-30a6-4d39-8829-eeaf75b44ad9 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:14.823579 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7f033e6a-30a6-4d39-8829-eeaf75b44ad9 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:14.824013 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7f033e6a-30a6-4d39-8829-eeaf75b44ad9 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:14.826669 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:14.826669 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:14.937346 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3019: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:14.937346 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context, Jul 13 02:33:15.015245 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2940: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:15.015245 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: query.update(values) Jul 13 02:33:15.017456 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2941: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:15.017456 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return query.first() Jul 13 02:33:15.103889 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2940: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:15.103889 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: query.update(values) Jul 13 02:33:15.106419 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2941: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:15.106419 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return query.first() Jul 13 02:33:15.129265 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-7f033e6a-30a6-4d39-8829-eeaf75b44ad9 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.317944 Jul 13 02:33:15.129887 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 461/913] 10.222.0.32 () {60 vars in 1323 bytes} [Tue Jul 13 02:33:14 2021] POST /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/os-volume_attachments => generated 194 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:33:15.741381 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-4d1e71a4-c7c3-4340-ab5b-72880bcd024f tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:15.742049 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-4d1e71a4-c7c3-4340-ab5b-72880bcd024f tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:15.747771 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-4d1e71a4-c7c3-4340-ab5b-72880bcd024f tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:15.748215 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-4d1e71a4-c7c3-4340-ab5b-72880bcd024f tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:15.748973 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-4d1e71a4-c7c3-4340-ab5b-72880bcd024f tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:15.749404 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-4d1e71a4-c7c3-4340-ab5b-72880bcd024f tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:15.752897 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:15.752897 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:15.933199 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-4d1e71a4-c7c3-4340-ab5b-72880bcd024f tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:15.935764 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:15.935764 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:33:15.943490 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-4d1e71a4-c7c3-4340-ab5b-72880bcd024f tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1755 microversion: 2.1 time: 0.205844 Jul 13 02:33:15.944052 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 453/914] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:33:15 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1755 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:33:16.961875 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-e4befff0-c588-4299-84fe-97759ccea9af tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:16.962585 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-e4befff0-c588-4299-84fe-97759ccea9af tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:16.968624 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e4befff0-c588-4299-84fe-97759ccea9af tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:16.969087 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e4befff0-c588-4299-84fe-97759ccea9af tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:16.969839 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e4befff0-c588-4299-84fe-97759ccea9af tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:16.970310 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e4befff0-c588-4299-84fe-97759ccea9af tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:16.973819 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:16.973819 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:17.146916 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-e4befff0-c588-4299-84fe-97759ccea9af tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:17.149488 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:17.149488 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:33:17.156662 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-e4befff0-c588-4299-84fe-97759ccea9af tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1755 microversion: 2.1 time: 0.199263 Jul 13 02:33:17.157215 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 462/915] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:33:16 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1755 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:33:18.173327 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-e8a93e26-f456-4147-bc40-b3fa6237f35d tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:18.174576 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-e8a93e26-f456-4147-bc40-b3fa6237f35d tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:18.180325 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e8a93e26-f456-4147-bc40-b3fa6237f35d tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:18.180771 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e8a93e26-f456-4147-bc40-b3fa6237f35d tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:18.181561 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e8a93e26-f456-4147-bc40-b3fa6237f35d tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:18.181994 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e8a93e26-f456-4147-bc40-b3fa6237f35d tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:18.184791 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:18.184791 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:18.356064 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-e8a93e26-f456-4147-bc40-b3fa6237f35d tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:18.358621 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:18.358621 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:33:18.366244 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-e8a93e26-f456-4147-bc40-b3fa6237f35d tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1755 microversion: 2.1 time: 0.196548 Jul 13 02:33:18.366801 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 454/916] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:33:18 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1755 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:33:19.382971 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-49f2bd2b-fe91-43c6-878e-c45bdef7dded tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:19.383587 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-49f2bd2b-fe91-43c6-878e-c45bdef7dded tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:19.390109 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-49f2bd2b-fe91-43c6-878e-c45bdef7dded tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:19.390550 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-49f2bd2b-fe91-43c6-878e-c45bdef7dded tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:19.391315 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-49f2bd2b-fe91-43c6-878e-c45bdef7dded tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:19.391750 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-49f2bd2b-fe91-43c6-878e-c45bdef7dded tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:19.394838 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:19.394838 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:19.571050 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-49f2bd2b-fe91-43c6-878e-c45bdef7dded tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:19.573647 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:19.573647 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:33:19.580957 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-49f2bd2b-fe91-43c6-878e-c45bdef7dded tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1755 microversion: 2.1 time: 0.201596 Jul 13 02:33:19.581606 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 463/917] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:33:19 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1755 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:33:20.598208 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-dea9ddd5-3cc5-4bca-a197-2e2caa6eeece tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:20.598823 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-dea9ddd5-3cc5-4bca-a197-2e2caa6eeece tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:20.604603 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-dea9ddd5-3cc5-4bca-a197-2e2caa6eeece tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:20.605057 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-dea9ddd5-3cc5-4bca-a197-2e2caa6eeece tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:20.605827 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-dea9ddd5-3cc5-4bca-a197-2e2caa6eeece tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:20.606288 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-dea9ddd5-3cc5-4bca-a197-2e2caa6eeece tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:20.609136 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:20.609136 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:20.779496 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-dea9ddd5-3cc5-4bca-a197-2e2caa6eeece tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:20.781984 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:20.781984 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:33:20.790011 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-dea9ddd5-3cc5-4bca-a197-2e2caa6eeece tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1755 microversion: 2.1 time: 0.196067 Jul 13 02:33:20.790597 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 455/918] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:33:20 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1755 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:33:21.806910 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-28a04a0c-373e-451c-82a3-9ee6f18ee69c tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:21.807518 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-28a04a0c-373e-451c-82a3-9ee6f18ee69c tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:21.813266 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-28a04a0c-373e-451c-82a3-9ee6f18ee69c tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:21.813704 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-28a04a0c-373e-451c-82a3-9ee6f18ee69c tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:21.814500 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-28a04a0c-373e-451c-82a3-9ee6f18ee69c tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:21.814920 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-28a04a0c-373e-451c-82a3-9ee6f18ee69c tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:21.818069 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:21.818069 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:21.997542 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-28a04a0c-373e-451c-82a3-9ee6f18ee69c tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:22.000180 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:22.000180 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:33:22.007806 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-28a04a0c-373e-451c-82a3-9ee6f18ee69c tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1758 microversion: 2.1 time: 0.204472 Jul 13 02:33:22.008385 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 464/919] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:33:21 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1758 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:33:22.580889 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-3d2defda-d3a0-4c13-a06f-aeffa3458e69 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:22.582711 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-3d2defda-d3a0-4c13-a06f-aeffa3458e69 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:22.588394 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3d2defda-d3a0-4c13-a06f-aeffa3458e69 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:22.588836 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3d2defda-d3a0-4c13-a06f-aeffa3458e69 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:22.589592 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3d2defda-d3a0-4c13-a06f-aeffa3458e69 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:22.590047 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3d2defda-d3a0-4c13-a06f-aeffa3458e69 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:22.592679 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:22.592679 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:22.654756 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3008: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:22.654756 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).\ Jul 13 02:33:22.662145 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-3d2defda-d3a0-4c13-a06f-aeffa3458e69 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.084918 Jul 13 02:33:22.662710 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 456/920] 10.222.0.32 () {58 vars in 1302 bytes} [Tue Jul 13 02:33:22 2021] GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/os-volume_attachments => generated 371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:33:38.241083 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-e77be5e8-6aef-444f-89ef-e288c7a7c8ea tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:38.241662 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-e77be5e8-6aef-444f-89ef-e288c7a7c8ea tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:38.248268 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e77be5e8-6aef-444f-89ef-e288c7a7c8ea tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:38.248746 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e77be5e8-6aef-444f-89ef-e288c7a7c8ea tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:38.249542 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e77be5e8-6aef-444f-89ef-e288c7a7c8ea tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:38.250226 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e77be5e8-6aef-444f-89ef-e288c7a7c8ea tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:38.253595 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:38.253595 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:38.317088 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3031: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:38.317088 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context, Jul 13 02:33:38.323346 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-e77be5e8-6aef-444f-89ef-e288c7a7c8ea tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/os-volume_attachments/fba5651a-0388-4e8c-a888-ddbaba45e031" status: 200 len: 194 microversion: 2.1 time: 0.086076 Jul 13 02:33:38.323919 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 465/921] 10.222.0.32 () {58 vars in 1413 bytes} [Tue Jul 13 02:33:38 2021] GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/os-volume_attachments/fba5651a-0388-4e8c-a888-ddbaba45e031 => generated 194 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:33:38.333904 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-ddc56494-4f34-48c4-9f90-bbcbf0f2e93c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:38.334482 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-ddc56494-4f34-48c4-9f90-bbcbf0f2e93c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:38.340650 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ddc56494-4f34-48c4-9f90-bbcbf0f2e93c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:38.341087 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ddc56494-4f34-48c4-9f90-bbcbf0f2e93c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:38.341839 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ddc56494-4f34-48c4-9f90-bbcbf0f2e93c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:38.342293 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ddc56494-4f34-48c4-9f90-bbcbf0f2e93c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:38.345006 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:38.345006 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:38.460306 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3031: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:38.460306 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context, Jul 13 02:33:38.466489 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.objects.instance [None req-ddc56494-4f34-48c4-9f90-bbcbf0f2e93c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lazy-loading 'services' on Instance uuid 358bc320-a9f0-47c9-aae8-72c8c45102f5 {{(pid=107262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 13 02:33:38.532338 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-ddc56494-4f34-48c4-9f90-bbcbf0f2e93c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "DELETE /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/os-volume_attachments/fba5651a-0388-4e8c-a888-ddbaba45e031" status: 202 len: 0 microversion: 2.1 time: 0.202646 Jul 13 02:33:38.533151 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 457/922] 10.222.0.32 () {58 vars in 1416 bytes} [Tue Jul 13 02:33:38 2021] DELETE /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/os-volume_attachments/fba5651a-0388-4e8c-a888-ddbaba45e031 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:33:40.706932 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-d267f50b-c279-499c-a71e-ba99d9993da0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:40.707453 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-d267f50b-c279-499c-a71e-ba99d9993da0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:40.713115 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d267f50b-c279-499c-a71e-ba99d9993da0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:40.713585 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d267f50b-c279-499c-a71e-ba99d9993da0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:40.714409 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d267f50b-c279-499c-a71e-ba99d9993da0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:40.714843 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-d267f50b-c279-499c-a71e-ba99d9993da0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:40.717471 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:40.717471 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:40.777622 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3031: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:40.777622 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context, Jul 13 02:33:40.784750 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-d267f50b-c279-499c-a71e-ba99d9993da0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/os-volume_attachments/cbcd07f2-cdfd-454e-addb-0eaaacefc910" status: 200 len: 194 microversion: 2.1 time: 0.081418 Jul 13 02:33:40.785518 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 466/923] 10.222.0.32 () {58 vars in 1413 bytes} [Tue Jul 13 02:33:40 2021] GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/os-volume_attachments/cbcd07f2-cdfd-454e-addb-0eaaacefc910 => generated 194 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:33:40.795333 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-48275a77-2ea7-4f60-bf78-93a3f92109d0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:40.795919 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-48275a77-2ea7-4f60-bf78-93a3f92109d0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:40.802098 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-48275a77-2ea7-4f60-bf78-93a3f92109d0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:40.802549 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-48275a77-2ea7-4f60-bf78-93a3f92109d0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:40.803323 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-48275a77-2ea7-4f60-bf78-93a3f92109d0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:40.803760 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-48275a77-2ea7-4f60-bf78-93a3f92109d0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:40.806580 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:40.806580 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:40.884994 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-e7274f91-1dd9-4c0c-aa6e-dc9027fa2a3b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:40.885495 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-e7274f91-1dd9-4c0c-aa6e-dc9027fa2a3b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:40.891469 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e7274f91-1dd9-4c0c-aa6e-dc9027fa2a3b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:40.891912 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e7274f91-1dd9-4c0c-aa6e-dc9027fa2a3b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:40.892669 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e7274f91-1dd9-4c0c-aa6e-dc9027fa2a3b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:40.893652 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e7274f91-1dd9-4c0c-aa6e-dc9027fa2a3b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:40.896539 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:40.896539 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:40.925453 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3031: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:40.925453 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context, Jul 13 02:33:40.931801 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.objects.instance [None req-48275a77-2ea7-4f60-bf78-93a3f92109d0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lazy-loading 'services' on Instance uuid 358bc320-a9f0-47c9-aae8-72c8c45102f5 {{(pid=107262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 13 02:33:40.959348 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-e7274f91-1dd9-4c0c-aa6e-dc9027fa2a3b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Going to try to terminate instance {{(pid=107263) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 13 02:33:40.961645 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3008: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:40.961645 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).\ Jul 13 02:33:40.974906 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:40.974906 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:40.996218 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-48275a77-2ea7-4f60-bf78-93a3f92109d0 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "DELETE /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/os-volume_attachments/cbcd07f2-cdfd-454e-addb-0eaaacefc910" status: 202 len: 0 microversion: 2.1 time: 0.204628 Jul 13 02:33:40.996965 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 458/924] 10.222.0.32 () {58 vars in 1416 bytes} [Tue Jul 13 02:33:40 2021] DELETE /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5/os-volume_attachments/cbcd07f2-cdfd-454e-addb-0eaaacefc910 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:33:41.033375 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/update_match.py:472: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:41.033375 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = query.session.execute(update_stmt) Jul 13 02:33:41.047290 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:530: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:41.047290 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = model_query(context, models.Service, read_deleted="no").\ Jul 13 02:33:41.079811 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-e7274f91-1dd9-4c0c-aa6e-dc9027fa2a3b tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "DELETE /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 204 len: 0 microversion: 2.20 time: 0.198213 Jul 13 02:33:41.080850 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 467/925] 10.222.0.32 () {60 vars in 1280 bytes} [Tue Jul 13 02:33:40 2021] DELETE /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 13 02:33:41.090510 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-ba4302d6-b57f-41fb-9081-958808a12045 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:41.090802 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-ba4302d6-b57f-41fb-9081-958808a12045 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:41.097271 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ba4302d6-b57f-41fb-9081-958808a12045 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:41.097719 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ba4302d6-b57f-41fb-9081-958808a12045 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:41.098512 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ba4302d6-b57f-41fb-9081-958808a12045 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:41.098939 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ba4302d6-b57f-41fb-9081-958808a12045 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:41.101925 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:41.101925 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:41.275555 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-ba4302d6-b57f-41fb-9081-958808a12045 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:41.278105 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:41.278105 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:33:41.286355 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-ba4302d6-b57f-41fb-9081-958808a12045 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:41.287850 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-ba4302d6-b57f-41fb-9081-958808a12045 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:41.288991 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-ba4302d6-b57f-41fb-9081-958808a12045 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1723 microversion: 2.20 time: 0.203480 Jul 13 02:33:41.289552 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 459/926] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:33:41 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:33:42.308551 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-67c4a57b-abfe-4b31-a261-33d5c042406c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:42.309153 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-66dc4273-a8e6-46b7-9c99-99394e3ab8ff tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:42.309540 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-67c4a57b-abfe-4b31-a261-33d5c042406c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:42.309701 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-66dc4273-a8e6-46b7-9c99-99394e3ab8ff tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:42.314831 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-67c4a57b-abfe-4b31-a261-33d5c042406c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:42.315313 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-67c4a57b-abfe-4b31-a261-33d5c042406c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:42.315727 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-66dc4273-a8e6-46b7-9c99-99394e3ab8ff tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:42.316082 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-67c4a57b-abfe-4b31-a261-33d5c042406c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:42.316262 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-66dc4273-a8e6-46b7-9c99-99394e3ab8ff tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:42.316514 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-67c4a57b-abfe-4b31-a261-33d5c042406c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:42.317038 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-66dc4273-a8e6-46b7-9c99-99394e3ab8ff tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:42.317477 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-66dc4273-a8e6-46b7-9c99-99394e3ab8ff tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:42.319348 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:42.319348 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:42.320379 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:42.320379 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:42.382053 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-67c4a57b-abfe-4b31-a261-33d5c042406c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Going to try to terminate instance {{(pid=107262) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 13 02:33:42.384330 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3008: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:42.384330 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).\ Jul 13 02:33:42.397694 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:42.397694 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:42.453152 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/update_match.py:472: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:42.453152 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = query.session.execute(update_stmt) Jul 13 02:33:42.467039 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:530: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:42.467039 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = model_query(context, models.Service, read_deleted="no").\ Jul 13 02:33:42.500242 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-67c4a57b-abfe-4b31-a261-33d5c042406c tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "DELETE /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5" status: 204 len: 0 microversion: 2.1 time: 0.194711 Jul 13 02:33:42.500830 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 460/927] 10.222.0.32 () {58 vars in 1239 bytes} [Tue Jul 13 02:33:42 2021] DELETE /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 13 02:33:42.500970 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-66dc4273-a8e6-46b7-9c99-99394e3ab8ff tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:42.505351 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:42.505351 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:33:42.509540 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-69f746b4-24b1-4b87-a3fc-5533b5cab676 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:42.510300 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-69f746b4-24b1-4b87-a3fc-5533b5cab676 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:42.514566 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-66dc4273-a8e6-46b7-9c99-99394e3ab8ff tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:42.516055 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-66dc4273-a8e6-46b7-9c99-99394e3ab8ff tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:42.516269 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-69f746b4-24b1-4b87-a3fc-5533b5cab676 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:42.516722 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-69f746b4-24b1-4b87-a3fc-5533b5cab676 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:42.517192 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-66dc4273-a8e6-46b7-9c99-99394e3ab8ff tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1723 microversion: 2.20 time: 0.212255 Jul 13 02:33:42.517494 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-69f746b4-24b1-4b87-a3fc-5533b5cab676 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:42.517748 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 468/928] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:33:42 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1723 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:33:42.517930 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-69f746b4-24b1-4b87-a3fc-5533b5cab676 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:42.521422 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:42.521422 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:42.694124 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-69f746b4-24b1-4b87-a3fc-5533b5cab676 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:42.696643 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:42.696643 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:33:42.703405 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-69f746b4-24b1-4b87-a3fc-5533b5cab676 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5" status: 200 len: 1674 microversion: 2.1 time: 0.198070 Jul 13 02:33:42.703907 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 461/929] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:33:42 2021] GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5 => generated 1674 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:33:43.536504 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-27d18301-fc86-4443-80dc-db56cd423fae tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:43.537705 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-27d18301-fc86-4443-80dc-db56cd423fae tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:43.543636 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-27d18301-fc86-4443-80dc-db56cd423fae tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:43.544142 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-27d18301-fc86-4443-80dc-db56cd423fae tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:43.544944 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-27d18301-fc86-4443-80dc-db56cd423fae tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:43.545380 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-27d18301-fc86-4443-80dc-db56cd423fae tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:43.548312 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:43.548312 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:43.660083 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-27d18301-fc86-4443-80dc-db56cd423fae tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:43.662636 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:43.662636 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:33:43.670200 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-27d18301-fc86-4443-80dc-db56cd423fae tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:43.671736 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-27d18301-fc86-4443-80dc-db56cd423fae tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fff5f367864fbb9a8731f6dfbc4d62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63a044a9d95c49ce9281f67e741cf8ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:43.672907 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-27d18301-fc86-4443-80dc-db56cd423fae tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 200 len: 1655 microversion: 2.20 time: 0.140747 Jul 13 02:33:43.683520 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 469/930] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:33:43 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 1655 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 13 02:33:43.721159 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-a4861ee0-6d6a-4da4-ab3b-ab67af63886d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:43.722789 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-a4861ee0-6d6a-4da4-ab3b-ab67af63886d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:43.729179 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a4861ee0-6d6a-4da4-ab3b-ab67af63886d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:43.729749 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a4861ee0-6d6a-4da4-ab3b-ab67af63886d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:43.730871 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a4861ee0-6d6a-4da4-ab3b-ab67af63886d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:43.731299 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a4861ee0-6d6a-4da4-ab3b-ab67af63886d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:43.734846 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:43.734846 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:43.736329 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [req-22048a09-ae9b-4f84-93c0-4f7db685b60b req-2a0bf930-3a9a-4636-9ded-3c10bc32e416 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcded031-14e6-4fa5-9a79-7e26c1aa0a0f", "name": "network-vif-deleted", "tag": "9e88c5ac-8fb9-44a9-a7fc-b323f20644f2"}]} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:33:43.737949 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:33:43.737949 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: warnings.warn(msg) Jul 13 02:33:43.749742 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-22048a09-ae9b-4f84-93c0-4f7db685b60b req-2a0bf930-3a9a-4636-9ded-3c10bc32e416 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:43.750228 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-22048a09-ae9b-4f84-93c0-4f7db685b60b req-2a0bf930-3a9a-4636-9ded-3c10bc32e416 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:43.763018 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.compute.server_external_events [req-22048a09-ae9b-4f84-93c0-4f7db685b60b req-2a0bf930-3a9a-4636-9ded-3c10bc32e416 service nova] Creating event network-vif-deleted:9e88c5ac-8fb9-44a9-a7fc-b323f20644f2 for instance bcded031-14e6-4fa5-9a79-7e26c1aa0a0f on hv-cinder-78102 Jul 13 02:33:43.769939 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [req-22048a09-ae9b-4f84-93c0-4f7db685b60b req-2a0bf930-3a9a-4636-9ded-3c10bc32e416 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040025 Jul 13 02:33:43.770815 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 470/931] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:33:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:33:43.956882 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-a4861ee0-6d6a-4da4-ab3b-ab67af63886d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:43.961199 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:43.961199 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:33:43.970433 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-a4861ee0-6d6a-4da4-ab3b-ab67af63886d tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5" status: 200 len: 1674 microversion: 2.1 time: 0.253507 Jul 13 02:33:43.981953 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 462/932] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:33:43 2021] GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5 => generated 1674 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:33:44.692126 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-998cc760-85ae-4d8b-b173-25627a1150ea tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:44.692838 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-998cc760-85ae-4d8b-b173-25627a1150ea tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:44.699421 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-998cc760-85ae-4d8b-b173-25627a1150ea tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:44.699974 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-998cc760-85ae-4d8b-b173-25627a1150ea tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:44.700818 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-998cc760-85ae-4d8b-b173-25627a1150ea tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:44.701256 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-998cc760-85ae-4d8b-b173-25627a1150ea tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:44.704463 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:44.704463 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:44.755328 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.wsgi [None req-998cc760-85ae-4d8b-b173-25627a1150ea tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] HTTP exception thrown: Instance bcded031-14e6-4fa5-9a79-7e26c1aa0a0f could not be found. Jul 13 02:33:44.755932 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-998cc760-85ae-4d8b-b173-25627a1150ea tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Returning 404 to user: Instance bcded031-14e6-4fa5-9a79-7e26c1aa0a0f could not be found. {{(pid=107263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:33:44.756780 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-998cc760-85ae-4d8b-b173-25627a1150ea tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 404 len: 111 microversion: 2.20 time: 0.069517 Jul 13 02:33:44.757654 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 471/933] 10.222.0.32 () {60 vars in 1277 bytes} [Tue Jul 13 02:33:44 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 13 02:33:44.766121 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-62c7a2f0-c344-4ae7-b7a1-489d09880ce3 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '.version_select at 0x7f43125c04c0>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:44.786197 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-62c7a2f0-c344-4ae7-b7a1-489d09880ce3 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-302677435" status: 204 len: 0 microversion: 2.20 time: 0.024056 Jul 13 02:33:44.786804 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 463/934] 10.222.0.32 () {60 vars in 1259 bytes} [Tue Jul 13 02:33:44 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-302677435 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 13 02:33:44.989013 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-7010da39-a80e-4f12-99ef-fded20fe9855 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:44.989619 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-7010da39-a80e-4f12-99ef-fded20fe9855 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:44.995591 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7010da39-a80e-4f12-99ef-fded20fe9855 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:45.002418 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7010da39-a80e-4f12-99ef-fded20fe9855 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:45.003076 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7010da39-a80e-4f12-99ef-fded20fe9855 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:45.003688 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-7010da39-a80e-4f12-99ef-fded20fe9855 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:45.007004 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:45.007004 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:45.301954 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-7010da39-a80e-4f12-99ef-fded20fe9855 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:45.304797 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:45.304797 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:33:45.314332 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-7010da39-a80e-4f12-99ef-fded20fe9855 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5" status: 200 len: 1674 microversion: 2.1 time: 0.329468 Jul 13 02:33:45.314887 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 472/935] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:33:44 2021] GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5 => generated 1674 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:33:45.790270 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-1a3cf9da-aa78-4fb2-9cc8-09c6d0b9005b req-c3970141-bc4a-4466-ac4c-3485e32a8b8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "358bc320-a9f0-47c9-aae8-72c8c45102f5", "name": "network-vif-deleted", "tag": "2f2dc5f8-6784-45e5-8b42-42c216edcb56"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:33:45.792169 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:33:45.792169 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:33:45.802925 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-1a3cf9da-aa78-4fb2-9cc8-09c6d0b9005b req-c3970141-bc4a-4466-ac4c-3485e32a8b8c service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:45.803657 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-1a3cf9da-aa78-4fb2-9cc8-09c6d0b9005b req-c3970141-bc4a-4466-ac4c-3485e32a8b8c service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:45.829329 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-1a3cf9da-aa78-4fb2-9cc8-09c6d0b9005b req-c3970141-bc4a-4466-ac4c-3485e32a8b8c service nova] Creating event network-vif-deleted:2f2dc5f8-6784-45e5-8b42-42c216edcb56 for instance 358bc320-a9f0-47c9-aae8-72c8c45102f5 on hv-cinder-78102 Jul 13 02:33:45.836359 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-1a3cf9da-aa78-4fb2-9cc8-09c6d0b9005b req-c3970141-bc4a-4466-ac4c-3485e32a8b8c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052730 Jul 13 02:33:45.837025 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 464/936] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:33:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:33:46.333004 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-5c80c4d9-66cd-4a2a-881b-909d6860c4e6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:46.333614 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-5c80c4d9-66cd-4a2a-881b-909d6860c4e6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:46.340486 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5c80c4d9-66cd-4a2a-881b-909d6860c4e6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:46.341135 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5c80c4d9-66cd-4a2a-881b-909d6860c4e6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:46.342092 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5c80c4d9-66cd-4a2a-881b-909d6860c4e6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:46.342810 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5c80c4d9-66cd-4a2a-881b-909d6860c4e6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:46.345913 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:46.345913 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:46.426259 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5c80c4d9-66cd-4a2a-881b-909d6860c4e6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:46.426397 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5c80c4d9-66cd-4a2a-881b-909d6860c4e6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:46.426821 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.objects.instance [None req-5c80c4d9-66cd-4a2a-881b-909d6860c4e6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lazy-loading 'fault' on Instance uuid 358bc320-a9f0-47c9-aae8-72c8c45102f5 {{(pid=107263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 13 02:33:46.429052 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:4002: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:46.429052 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: for row in query: Jul 13 02:33:46.469174 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-5c80c4d9-66cd-4a2a-881b-909d6860c4e6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d3696355aae4727ae610990c9efb5eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '197b525e7a104e5ebcd262a734055741', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:33:46.472504 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:46.472504 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:33:46.479073 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-5c80c4d9-66cd-4a2a-881b-909d6860c4e6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5" status: 200 len: 1328 microversion: 2.1 time: 0.150307 Jul 13 02:33:46.479650 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 473/937] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:33:46 2021] GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5 => generated 1328 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:33:46.585668 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-f0449595-bdd8-4be6-bde1-22ef69c976e8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:46.586299 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-f0449595-bdd8-4be6-bde1-22ef69c976e8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:46.592462 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f0449595-bdd8-4be6-bde1-22ef69c976e8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:46.592903 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f0449595-bdd8-4be6-bde1-22ef69c976e8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:46.593682 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f0449595-bdd8-4be6-bde1-22ef69c976e8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:46.594141 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f0449595-bdd8-4be6-bde1-22ef69c976e8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:46.597628 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:46.597628 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:46.645036 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.wsgi [None req-f0449595-bdd8-4be6-bde1-22ef69c976e8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] HTTP exception thrown: Instance bcded031-14e6-4fa5-9a79-7e26c1aa0a0f could not be found. Jul 13 02:33:46.645633 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-f0449595-bdd8-4be6-bde1-22ef69c976e8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Returning 404 to user: Instance bcded031-14e6-4fa5-9a79-7e26c1aa0a0f could not be found. {{(pid=107262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:33:46.646513 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-f0449595-bdd8-4be6-bde1-22ef69c976e8 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "DELETE /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 404 len: 111 microversion: 2.1 time: 0.064834 Jul 13 02:33:46.647083 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 465/938] 10.222.0.32 () {58 vars in 1239 bytes} [Tue Jul 13 02:33:46 2021] DELETE /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 02:33:46.654884 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-8d474acd-9b00-4808-99e2-17f84594bb11 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:46.655494 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-8d474acd-9b00-4808-99e2-17f84594bb11 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: bcded031-14e6-4fa5-9a79-7e26c1aa0a0f] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:46.662196 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8d474acd-9b00-4808-99e2-17f84594bb11 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:46.662678 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8d474acd-9b00-4808-99e2-17f84594bb11 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:46.663459 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8d474acd-9b00-4808-99e2-17f84594bb11 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:46.663893 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-8d474acd-9b00-4808-99e2-17f84594bb11 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:46.667035 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:46.667035 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:46.713060 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.wsgi [None req-8d474acd-9b00-4808-99e2-17f84594bb11 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] HTTP exception thrown: Instance bcded031-14e6-4fa5-9a79-7e26c1aa0a0f could not be found. Jul 13 02:33:46.713664 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-8d474acd-9b00-4808-99e2-17f84594bb11 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Returning 404 to user: Instance bcded031-14e6-4fa5-9a79-7e26c1aa0a0f could not be found. {{(pid=107263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:33:46.714533 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-8d474acd-9b00-4808-99e2-17f84594bb11 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f" status: 404 len: 111 microversion: 2.1 time: 0.063340 Jul 13 02:33:46.715280 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 474/939] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:33:46 2021] GET /compute/v2.1/servers/bcded031-14e6-4fa5-9a79-7e26c1aa0a0f => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 02:33:47.496279 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-166b74ad-d075-427f-a1e0-2918ecb154a3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:47.496885 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-166b74ad-d075-427f-a1e0-2918ecb154a3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:47.503289 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-166b74ad-d075-427f-a1e0-2918ecb154a3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:47.503883 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-166b74ad-d075-427f-a1e0-2918ecb154a3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:47.504626 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-166b74ad-d075-427f-a1e0-2918ecb154a3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:47.505054 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-166b74ad-d075-427f-a1e0-2918ecb154a3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:47.507834 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:47.507834 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:47.551662 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.wsgi [None req-166b74ad-d075-427f-a1e0-2918ecb154a3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] HTTP exception thrown: Instance 358bc320-a9f0-47c9-aae8-72c8c45102f5 could not be found. Jul 13 02:33:47.552233 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-166b74ad-d075-427f-a1e0-2918ecb154a3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Returning 404 to user: Instance 358bc320-a9f0-47c9-aae8-72c8c45102f5 could not be found. {{(pid=107262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:33:47.553049 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-166b74ad-d075-427f-a1e0-2918ecb154a3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5" status: 404 len: 111 microversion: 2.1 time: 0.060547 Jul 13 02:33:47.553572 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 466/940] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:33:47 2021] GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 02:33:47.561617 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-2257f651-d573-44d9-8a18-2db8951a4ff3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '.version_select at 0x7f4313914e50>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:47.579973 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-2257f651-d573-44d9-8a18-2db8951a4ff3 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1319201673" status: 202 len: 0 microversion: 2.1 time: 0.021931 Jul 13 02:33:47.580526 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 475/941] 10.222.0.32 () {58 vars in 1221 bytes} [Tue Jul 13 02:33:47 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1319201673 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:33:47.852385 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-f4084e01-d72a-4435-a686-ceedcde00a1a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:47.853005 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-f4084e01-d72a-4435-a686-ceedcde00a1a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:47.858820 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f4084e01-d72a-4435-a686-ceedcde00a1a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:47.859262 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f4084e01-d72a-4435-a686-ceedcde00a1a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:47.860028 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f4084e01-d72a-4435-a686-ceedcde00a1a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:47.860456 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f4084e01-d72a-4435-a686-ceedcde00a1a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:47.863498 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:47.863498 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:47.914285 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.wsgi [None req-f4084e01-d72a-4435-a686-ceedcde00a1a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] HTTP exception thrown: Instance 872b8d83-fdcf-4888-b1d3-64f49541426d could not be found. Jul 13 02:33:47.914824 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-f4084e01-d72a-4435-a686-ceedcde00a1a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Returning 404 to user: Instance 872b8d83-fdcf-4888-b1d3-64f49541426d could not be found. {{(pid=107262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:33:47.915669 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-f4084e01-d72a-4435-a686-ceedcde00a1a tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "DELETE /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 404 len: 111 microversion: 2.1 time: 0.067470 Jul 13 02:33:47.916223 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 467/942] 10.222.0.32 () {58 vars in 1239 bytes} [Tue Jul 13 02:33:47 2021] DELETE /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 02:33:47.924631 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-f633d48a-6990-476a-8fc2-1b4035b7ff34 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:47.925359 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-f633d48a-6990-476a-8fc2-1b4035b7ff34 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] [instance: 872b8d83-fdcf-4888-b1d3-64f49541426d] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:47.931087 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f633d48a-6990-476a-8fc2-1b4035b7ff34 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:47.931539 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f633d48a-6990-476a-8fc2-1b4035b7ff34 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:47.932653 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f633d48a-6990-476a-8fc2-1b4035b7ff34 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:47.933097 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-f633d48a-6990-476a-8fc2-1b4035b7ff34 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:47.936007 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:47.936007 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:47.981831 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.wsgi [None req-f633d48a-6990-476a-8fc2-1b4035b7ff34 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] HTTP exception thrown: Instance 872b8d83-fdcf-4888-b1d3-64f49541426d could not be found. Jul 13 02:33:47.982381 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-f633d48a-6990-476a-8fc2-1b4035b7ff34 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] Returning 404 to user: Instance 872b8d83-fdcf-4888-b1d3-64f49541426d could not be found. {{(pid=107263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:33:47.983223 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-f633d48a-6990-476a-8fc2-1b4035b7ff34 tempest-AttachVolumeShelveTestJSON-745527671 tempest-AttachVolumeShelveTestJSON-745527671-project] 10.222.0.32 "GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d" status: 404 len: 111 microversion: 2.1 time: 0.062866 Jul 13 02:33:47.983782 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 476/943] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:33:47 2021] GET /compute/v2.1/servers/872b8d83-fdcf-4888-b1d3-64f49541426d => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 13 02:33:50.785563 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-3c8d3381-92c8-4e0c-b145-233524e5a8d6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:50.786336 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-3c8d3381-92c8-4e0c-b145-233524e5a8d6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:50.792577 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3c8d3381-92c8-4e0c-b145-233524e5a8d6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:50.793015 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3c8d3381-92c8-4e0c-b145-233524e5a8d6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:50.793790 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3c8d3381-92c8-4e0c-b145-233524e5a8d6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:50.794258 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3c8d3381-92c8-4e0c-b145-233524e5a8d6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:50.797332 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:50.797332 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:50.845177 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.wsgi [None req-3c8d3381-92c8-4e0c-b145-233524e5a8d6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] HTTP exception thrown: Instance 358bc320-a9f0-47c9-aae8-72c8c45102f5 could not be found. Jul 13 02:33:50.845770 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-3c8d3381-92c8-4e0c-b145-233524e5a8d6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Returning 404 to user: Instance 358bc320-a9f0-47c9-aae8-72c8c45102f5 could not be found. {{(pid=107262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:33:50.847105 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-3c8d3381-92c8-4e0c-b145-233524e5a8d6 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "DELETE /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5" status: 404 len: 111 microversion: 2.1 time: 0.065991 Jul 13 02:33:50.847905 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 468/944] 10.222.0.32 () {58 vars in 1239 bytes} [Tue Jul 13 02:33:50 2021] DELETE /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 02:33:50.855672 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-ab317382-4f12-4bf9-9f64-a12e96b128bf tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:50.856835 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-ab317382-4f12-4bf9-9f64-a12e96b128bf tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: 358bc320-a9f0-47c9-aae8-72c8c45102f5] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:50.863280 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ab317382-4f12-4bf9-9f64-a12e96b128bf tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:50.863733 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ab317382-4f12-4bf9-9f64-a12e96b128bf tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:50.864507 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ab317382-4f12-4bf9-9f64-a12e96b128bf tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:50.864937 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ab317382-4f12-4bf9-9f64-a12e96b128bf tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:50.868105 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:50.868105 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:50.919405 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.wsgi [None req-ab317382-4f12-4bf9-9f64-a12e96b128bf tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] HTTP exception thrown: Instance 358bc320-a9f0-47c9-aae8-72c8c45102f5 could not be found. Jul 13 02:33:50.920017 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-ab317382-4f12-4bf9-9f64-a12e96b128bf tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Returning 404 to user: Instance 358bc320-a9f0-47c9-aae8-72c8c45102f5 could not be found. {{(pid=107263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:33:50.920920 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-ab317382-4f12-4bf9-9f64-a12e96b128bf tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5" status: 404 len: 111 microversion: 2.1 time: 0.068882 Jul 13 02:33:50.921480 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 477/945] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:33:50 2021] GET /compute/v2.1/servers/358bc320-a9f0-47c9-aae8-72c8c45102f5 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 02:33:52.067863 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-3827e1fc-8482-4942-97e8-16bd277b6b6a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:52.068384 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-3827e1fc-8482-4942-97e8-16bd277b6b6a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:52.073988 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3827e1fc-8482-4942-97e8-16bd277b6b6a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:52.074464 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3827e1fc-8482-4942-97e8-16bd277b6b6a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:52.075226 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3827e1fc-8482-4942-97e8-16bd277b6b6a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:52.075658 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3827e1fc-8482-4942-97e8-16bd277b6b6a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:52.078481 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:52.078481 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:52.126631 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.wsgi [None req-3827e1fc-8482-4942-97e8-16bd277b6b6a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] HTTP exception thrown: Instance c8f2132c-4b9b-4c53-81c5-29e734143042 could not be found. Jul 13 02:33:52.127220 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-3827e1fc-8482-4942-97e8-16bd277b6b6a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Returning 404 to user: Instance c8f2132c-4b9b-4c53-81c5-29e734143042 could not be found. {{(pid=107262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:33:52.128645 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-3827e1fc-8482-4942-97e8-16bd277b6b6a tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "DELETE /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 404 len: 111 microversion: 2.1 time: 0.065845 Jul 13 02:33:52.129192 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 469/946] 10.222.0.32 () {58 vars in 1239 bytes} [Tue Jul 13 02:33:52 2021] DELETE /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 02:33:52.137029 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-5448af4b-23ef-4db1-9b90-4ad4a34d7841 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:52.137912 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-5448af4b-23ef-4db1-9b90-4ad4a34d7841 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] [instance: c8f2132c-4b9b-4c53-81c5-29e734143042] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:52.144343 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5448af4b-23ef-4db1-9b90-4ad4a34d7841 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:52.144791 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5448af4b-23ef-4db1-9b90-4ad4a34d7841 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:52.145558 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5448af4b-23ef-4db1-9b90-4ad4a34d7841 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:52.145995 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-5448af4b-23ef-4db1-9b90-4ad4a34d7841 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:52.148914 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:52.148914 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:52.193541 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.wsgi [None req-5448af4b-23ef-4db1-9b90-4ad4a34d7841 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] HTTP exception thrown: Instance c8f2132c-4b9b-4c53-81c5-29e734143042 could not be found. Jul 13 02:33:52.194165 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-5448af4b-23ef-4db1-9b90-4ad4a34d7841 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] Returning 404 to user: Instance c8f2132c-4b9b-4c53-81c5-29e734143042 could not be found. {{(pid=107263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:33:52.195004 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-5448af4b-23ef-4db1-9b90-4ad4a34d7841 tempest-AttachVolumeTestJSON-29582813 tempest-AttachVolumeTestJSON-29582813-project] 10.222.0.32 "GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042" status: 404 len: 111 microversion: 2.1 time: 0.061652 Jul 13 02:33:52.195554 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 478/947] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:33:52 2021] GET /compute/v2.1/servers/c8f2132c-4b9b-4c53-81c5-29e734143042 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 13 02:33:55.207806 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-a5e4b36c-42ce-46bc-b0ce-4d5f564aa0a7 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-82635105"}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:33:55.208648 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-a5e4b36c-42ce-46bc-b0ce-4d5f564aa0a7 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:55.215839 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a5e4b36c-42ce-46bc-b0ce-4d5f564aa0a7 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:55.216842 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a5e4b36c-42ce-46bc-b0ce-4d5f564aa0a7 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:55.217925 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a5e4b36c-42ce-46bc-b0ce-4d5f564aa0a7 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:55.218393 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a5e4b36c-42ce-46bc-b0ce-4d5f564aa0a7 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:55.221793 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:55.221793 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:55.516270 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.network.security_group_api [None req-a5e4b36c-42ce-46bc-b0ce-4d5f564aa0a7 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Removing security group 04b50ca5-d374-47b2-be59-e8ff3a2b65a6 from port bc4abdbb-fe6a-4872-b0b8-aca5ec258475 Jul 13 02:33:56.202582 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-a5e4b36c-42ce-46bc-b0ce-4d5f564aa0a7 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "POST /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525/action" status: 202 len: 0 microversion: 2.1 time: 0.999287 Jul 13 02:33:56.206845 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 470/948] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:33:55 2021] POST /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525/action => generated 0 bytes in 1001 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 13 02:33:56.215056 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [req-aa45762f-887d-45d6-9520-67536ba5513c req-ddee1c25-7b68-4e0d-8a97-162acdad22d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "578a1bf5-b64e-45c5-ac82-32809189a525", "tag": "bc4abdbb-fe6a-4872-b0b8-aca5ec258475"}]} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:33:56.217273 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:33:56.217273 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: warnings.warn(msg) Jul 13 02:33:56.242205 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-aa45762f-887d-45d6-9520-67536ba5513c req-ddee1c25-7b68-4e0d-8a97-162acdad22d8 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:56.243896 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-aa45762f-887d-45d6-9520-67536ba5513c req-ddee1c25-7b68-4e0d-8a97-162acdad22d8 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:56.261891 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.compute.server_external_events [req-aa45762f-887d-45d6-9520-67536ba5513c req-ddee1c25-7b68-4e0d-8a97-162acdad22d8 service nova] Creating event network-changed:bc4abdbb-fe6a-4872-b0b8-aca5ec258475 for instance 578a1bf5-b64e-45c5-ac82-32809189a525 on hv-cinder-78102 Jul 13 02:33:56.268825 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [req-aa45762f-887d-45d6-9520-67536ba5513c req-ddee1c25-7b68-4e0d-8a97-162acdad22d8 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057241 Jul 13 02:33:56.270374 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 479/949] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:33:56 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:33:57.016275 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-2d3e7a92-3e51-4d2c-b26d-909f4a9b83ce tempest-VolumesGetTestJSON-373824685 tempest-VolumesGetTestJSON-373824685-project] Action: 'create', calling method: .version_select at 0x7f4313992040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2074531312", "metadata": {"Type": "work"}}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:33:57.373413 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-2d3e7a92-3e51-4d2c-b26d-909f4a9b83ce tempest-VolumesGetTestJSON-373824685 tempest-VolumesGetTestJSON-373824685-project] 10.222.0.32 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.534123 Jul 13 02:33:57.374859 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 471/950] 10.222.0.32 () {60 vars in 1156 bytes} [Tue Jul 13 02:33:56 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 536 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 13 02:33:57.387491 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-bfeb17bf-8823-476a-99e1-09ba67306006 tempest-VolumesGetTestJSON-373824685 tempest-VolumesGetTestJSON-373824685-project] Calling method '.version_select at 0x7f4312d6ab80>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:57.448659 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-bfeb17bf-8823-476a-99e1-09ba67306006 tempest-VolumesGetTestJSON-373824685 tempest-VolumesGetTestJSON-373824685-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/e9e80427-68a7-4695-9076-1845a42f6e71" status: 200 len: 353 microversion: 2.1 time: 0.066254 Jul 13 02:33:57.449217 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 480/951] 10.222.0.32 () {58 vars in 1245 bytes} [Tue Jul 13 02:33:57 2021] GET /compute/v2.1/os-volumes/e9e80427-68a7-4695-9076-1845a42f6e71 => generated 353 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 02:33:57.944074 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-d7e50c01-6e76-48f1-8e43-ab1ad963f02c tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:57.944530 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-d7e50c01-6e76-48f1-8e43-ab1ad963f02c tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:57.952294 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [req-a559fb66-c474-49f4-86ff-78c1ddff5f74 req-0acf55de-9c7d-4ce9-9f59-64be0d2f66a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "578a1bf5-b64e-45c5-ac82-32809189a525", "tag": "bc4abdbb-fe6a-4872-b0b8-aca5ec258475"}]} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:33:57.953786 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:33:57.953786 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: warnings.warn(msg) Jul 13 02:33:57.955114 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d7e50c01-6e76-48f1-8e43-ab1ad963f02c tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:57.955781 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d7e50c01-6e76-48f1-8e43-ab1ad963f02c tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:57.956948 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d7e50c01-6e76-48f1-8e43-ab1ad963f02c tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:57.957932 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d7e50c01-6e76-48f1-8e43-ab1ad963f02c tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:57.961190 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:57.961190 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:57.963011 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-a559fb66-c474-49f4-86ff-78c1ddff5f74 req-0acf55de-9c7d-4ce9-9f59-64be0d2f66a5 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:57.963457 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-a559fb66-c474-49f4-86ff-78c1ddff5f74 req-0acf55de-9c7d-4ce9-9f59-64be0d2f66a5 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:57.978222 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.compute.server_external_events [req-a559fb66-c474-49f4-86ff-78c1ddff5f74 req-0acf55de-9c7d-4ce9-9f59-64be0d2f66a5 service nova] Creating event network-changed:bc4abdbb-fe6a-4872-b0b8-aca5ec258475 for instance 578a1bf5-b64e-45c5-ac82-32809189a525 on hv-cinder-78102 Jul 13 02:33:57.983321 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [req-a559fb66-c474-49f4-86ff-78c1ddff5f74 req-0acf55de-9c7d-4ce9-9f59-64be0d2f66a5 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035431 Jul 13 02:33:57.984083 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 481/952] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:33:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 02:33:58.092955 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3031: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:58.092955 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context, Jul 13 02:33:58.100625 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.objects.instance [None req-d7e50c01-6e76-48f1-8e43-ab1ad963f02c tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lazy-loading 'services' on Instance uuid 578a1bf5-b64e-45c5-ac82-32809189a525 {{(pid=107262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 13 02:33:58.182793 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-d7e50c01-6e76-48f1-8e43-ab1ad963f02c tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "DELETE /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525/os-volume_attachments/d9c7459b-9196-4ba2-97e0-3052d4fc8cef" status: 202 len: 0 microversion: 2.1 time: 0.242233 Jul 13 02:33:58.183788 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 472/953] 10.222.0.32 () {58 vars in 1416 bytes} [Tue Jul 13 02:33:57 2021] DELETE /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525/os-volume_attachments/d9c7459b-9196-4ba2-97e0-3052d4fc8cef => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 13 02:33:58.195785 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-c6acb605-69a9-4bdb-9919-96513d9a1e96 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:58.197728 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-c6acb605-69a9-4bdb-9919-96513d9a1e96 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:58.206725 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c6acb605-69a9-4bdb-9919-96513d9a1e96 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:58.207599 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c6acb605-69a9-4bdb-9919-96513d9a1e96 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:58.210003 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c6acb605-69a9-4bdb-9919-96513d9a1e96 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:58.210652 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-c6acb605-69a9-4bdb-9919-96513d9a1e96 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:58.214005 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:58.214005 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:58.319760 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3008: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:58.319760 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).\ Jul 13 02:33:58.328620 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-c6acb605-69a9-4bdb-9919-96513d9a1e96 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.139075 Jul 13 02:33:58.332562 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 482/954] 10.222.0.32 () {58 vars in 1302 bytes} [Tue Jul 13 02:33:58 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525/os-volume_attachments => generated 197 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:33:58.462659 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-d79b1e2f-3c5b-4c34-94d7-b95f002e0a09 tempest-VolumesGetTestJSON-373824685 tempest-VolumesGetTestJSON-373824685-project] Calling method '.version_select at 0x7f43125c0c10>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:58.528058 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-d79b1e2f-3c5b-4c34-94d7-b95f002e0a09 tempest-VolumesGetTestJSON-373824685 tempest-VolumesGetTestJSON-373824685-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/e9e80427-68a7-4695-9076-1845a42f6e71" status: 200 len: 354 microversion: 2.1 time: 0.070052 Jul 13 02:33:58.535553 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 473/955] 10.222.0.32 () {58 vars in 1245 bytes} [Tue Jul 13 02:33:58 2021] GET /compute/v2.1/os-volumes/e9e80427-68a7-4695-9076-1845a42f6e71 => generated 354 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:33:58.540164 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-6067404a-48ca-43d3-a187-7cfc653c6d3b tempest-VolumesGetTestJSON-373824685 tempest-VolumesGetTestJSON-373824685-project] Calling method '.version_select at 0x7f43138ced30>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:58.608381 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-6067404a-48ca-43d3-a187-7cfc653c6d3b tempest-VolumesGetTestJSON-373824685 tempest-VolumesGetTestJSON-373824685-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/e9e80427-68a7-4695-9076-1845a42f6e71" status: 200 len: 354 microversion: 2.1 time: 0.071622 Jul 13 02:33:58.608867 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 483/956] 10.222.0.32 () {58 vars in 1245 bytes} [Tue Jul 13 02:33:58 2021] GET /compute/v2.1/os-volumes/e9e80427-68a7-4695-9076-1845a42f6e71 => generated 354 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 02:33:58.625581 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-0c2ba18f-2cfa-4a0c-b47e-27a86f56a0c2 tempest-VolumesGetTestJSON-373824685 tempest-VolumesGetTestJSON-373824685-project] Calling method '.version_select at 0x7f431256d670>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:58.704145 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-0c2ba18f-2cfa-4a0c-b47e-27a86f56a0c2 tempest-VolumesGetTestJSON-373824685 tempest-VolumesGetTestJSON-373824685-project] 10.222.0.32 "DELETE /compute/v2.1/os-volumes/e9e80427-68a7-4695-9076-1845a42f6e71" status: 202 len: 0 microversion: 2.1 time: 0.081682 Jul 13 02:33:58.705151 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 474/957] 10.222.0.32 () {58 vars in 1248 bytes} [Tue Jul 13 02:33:58 2021] DELETE /compute/v2.1/os-volumes/e9e80427-68a7-4695-9076-1845a42f6e71 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:33:58.713552 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-3185ea3b-e45a-4cf0-905b-3cd2e197ab5d tempest-VolumesGetTestJSON-373824685 tempest-VolumesGetTestJSON-373824685-project] Calling method '.version_select at 0x7f4312ba0ee0>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:58.794989 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-3185ea3b-e45a-4cf0-905b-3cd2e197ab5d tempest-VolumesGetTestJSON-373824685 tempest-VolumesGetTestJSON-373824685-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/e9e80427-68a7-4695-9076-1845a42f6e71" status: 200 len: 353 microversion: 2.1 time: 0.084982 Jul 13 02:33:58.795652 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 484/958] 10.222.0.32 () {58 vars in 1245 bytes} [Tue Jul 13 02:33:58 2021] GET /compute/v2.1/os-volumes/e9e80427-68a7-4695-9076-1845a42f6e71 => generated 353 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 02:33:59.343605 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-ede78d62-4d6e-464c-a09b-768197252ddd tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:59.345336 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-ede78d62-4d6e-464c-a09b-768197252ddd tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:59.352291 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ede78d62-4d6e-464c-a09b-768197252ddd tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:59.352877 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ede78d62-4d6e-464c-a09b-768197252ddd tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:59.353891 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ede78d62-4d6e-464c-a09b-768197252ddd tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:59.354431 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ede78d62-4d6e-464c-a09b-768197252ddd tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:59.357820 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:59.357820 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:59.423195 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3008: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:59.423195 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).\ Jul 13 02:33:59.431383 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-ede78d62-4d6e-464c-a09b-768197252ddd tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.091940 Jul 13 02:33:59.436502 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 475/959] 10.222.0.32 () {58 vars in 1302 bytes} [Tue Jul 13 02:33:59 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525/os-volume_attachments => generated 25 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 13 02:33:59.442777 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-cc7302a4-7c14-4ef9-b8ba-1dca448beb1d tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:59.443287 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-cc7302a4-7c14-4ef9-b8ba-1dca448beb1d tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:33:59.450247 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-cc7302a4-7c14-4ef9-b8ba-1dca448beb1d tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:59.451050 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-cc7302a4-7c14-4ef9-b8ba-1dca448beb1d tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:59.451918 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-cc7302a4-7c14-4ef9-b8ba-1dca448beb1d tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:33:59.452278 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-cc7302a4-7c14-4ef9-b8ba-1dca448beb1d tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:33:59.455595 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:59.455595 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:33:59.593974 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3031: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:33:59.593974 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context, Jul 13 02:33:59.603872 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.wsgi [None req-cc7302a4-7c14-4ef9-b8ba-1dca448beb1d tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] HTTP exception thrown: Instance 578a1bf5-b64e-45c5-ac82-32809189a525 is not attached to volume d9c7459b-9196-4ba2-97e0-3052d4fc8cef Jul 13 02:33:59.604696 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-cc7302a4-7c14-4ef9-b8ba-1dca448beb1d tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Returning 404 to user: Instance 578a1bf5-b64e-45c5-ac82-32809189a525 is not attached to volume d9c7459b-9196-4ba2-97e0-3052d4fc8cef {{(pid=107263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:33:59.605934 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-cc7302a4-7c14-4ef9-b8ba-1dca448beb1d tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "DELETE /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525/os-volume_attachments/d9c7459b-9196-4ba2-97e0-3052d4fc8cef" status: 404 len: 154 microversion: 2.1 time: 0.168106 Jul 13 02:33:59.607401 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 485/960] 10.222.0.32 () {58 vars in 1416 bytes} [Tue Jul 13 02:33:59 2021] DELETE /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525/os-volume_attachments/d9c7459b-9196-4ba2-97e0-3052d4fc8cef => generated 154 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 02:33:59.807082 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-797d17a9-37be-485e-9725-b06ed30ba26a tempest-VolumesGetTestJSON-373824685 tempest-VolumesGetTestJSON-373824685-project] Calling method '.version_select at 0x7f431256d310>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:33:59.838288 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.wsgi [None req-797d17a9-37be-485e-9725-b06ed30ba26a tempest-VolumesGetTestJSON-373824685 tempest-VolumesGetTestJSON-373824685-project] HTTP exception thrown: Volume e9e80427-68a7-4695-9076-1845a42f6e71 could not be found. Jul 13 02:33:59.839081 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-797d17a9-37be-485e-9725-b06ed30ba26a tempest-VolumesGetTestJSON-373824685 tempest-VolumesGetTestJSON-373824685-project] Returning 404 to user: Volume e9e80427-68a7-4695-9076-1845a42f6e71 could not be found. {{(pid=107262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:33:59.840639 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-797d17a9-37be-485e-9725-b06ed30ba26a tempest-VolumesGetTestJSON-373824685 tempest-VolumesGetTestJSON-373824685-project] 10.222.0.32 "GET /compute/v2.1/os-volumes/e9e80427-68a7-4695-9076-1845a42f6e71" status: 404 len: 109 microversion: 2.1 time: 0.037392 Jul 13 02:33:59.844929 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 476/961] 10.222.0.32 () {58 vars in 1245 bytes} [Tue Jul 13 02:33:59 2021] GET /compute/v2.1/os-volumes/e9e80427-68a7-4695-9076-1845a42f6e71 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 02:34:00.769958 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-03286c73-24a4-49b1-a45b-623c1716edf7 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:34:00.770465 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-03286c73-24a4-49b1-a45b-623c1716edf7 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:34:00.776222 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-03286c73-24a4-49b1-a45b-623c1716edf7 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:00.776661 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-03286c73-24a4-49b1-a45b-623c1716edf7 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:00.777424 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-03286c73-24a4-49b1-a45b-623c1716edf7 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:00.777852 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-03286c73-24a4-49b1-a45b-623c1716edf7 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:00.780678 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:00.780678 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:34:00.843748 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-03286c73-24a4-49b1-a45b-623c1716edf7 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Going to try to terminate instance {{(pid=107263) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 13 02:34:00.845944 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3008: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:00.845944 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).\ Jul 13 02:34:00.858571 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:00.858571 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:34:00.918068 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/update_match.py:472: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:00.918068 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = query.session.execute(update_stmt) Jul 13 02:34:00.932197 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:530: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:00.932197 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = model_query(context, models.Service, read_deleted="no").\ Jul 13 02:34:00.967475 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-03286c73-24a4-49b1-a45b-623c1716edf7 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "DELETE /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 204 len: 0 microversion: 2.1 time: 0.201563 Jul 13 02:34:00.968011 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 486/962] 10.222.0.32 () {58 vars in 1239 bytes} [Tue Jul 13 02:34:00 2021] DELETE /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 13 02:34:00.976663 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-5d01afbd-0981-44aa-b018-ee8b716069b1 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:34:00.977277 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-5d01afbd-0981-44aa-b018-ee8b716069b1 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:34:00.984018 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5d01afbd-0981-44aa-b018-ee8b716069b1 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:00.984473 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5d01afbd-0981-44aa-b018-ee8b716069b1 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:00.985243 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5d01afbd-0981-44aa-b018-ee8b716069b1 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:00.985683 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5d01afbd-0981-44aa-b018-ee8b716069b1 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:00.989128 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:00.989128 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:34:01.168344 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-5d01afbd-0981-44aa-b018-ee8b716069b1 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:34:01.170954 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:01.170954 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:34:01.177807 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-5d01afbd-0981-44aa-b018-ee8b716069b1 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1554 microversion: 2.1 time: 0.205180 Jul 13 02:34:01.178387 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 477/963] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:34:00 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1554 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:34:01.883966 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-dcadb4f2-6253-4668-98f1-792126955054 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1698009100", "imageRef": "1a3efd47-3618-4abd-b00b-a9fa9b90b4d4", "flavorRef": "452", "networks": [{"uuid": "fe7fb172-0d2b-4b8e-9cdf-93d66698e34c"}]}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:34:01.948229 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.network.neutron [None req-dcadb4f2-6253-4668-98f1-792126955054 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] validate_networks() for [('fe7fb172-0d2b-4b8e-9cdf-93d66698e34c', None, None, None)] {{(pid=107263) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Jul 13 02:34:02.195666 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-4839f92e-d7c8-45f2-9d73-2c2600b42ddd tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:34:02.196359 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-4839f92e-d7c8-45f2-9d73-2c2600b42ddd tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:34:02.202148 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-4839f92e-d7c8-45f2-9d73-2c2600b42ddd tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:02.202598 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-4839f92e-d7c8-45f2-9d73-2c2600b42ddd tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:02.203370 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-4839f92e-d7c8-45f2-9d73-2c2600b42ddd tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:02.203802 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-4839f92e-d7c8-45f2-9d73-2c2600b42ddd tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:02.207491 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:02.207491 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:34:02.354185 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-dcadb4f2-6253-4668-98f1-792126955054 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Flavor limits 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 02:34:02.354864 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-dcadb4f2-6253-4668-98f1-792126955054 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Image limits 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 02:34:02.355378 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-dcadb4f2-6253-4668-98f1-792126955054 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Flavor pref 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 02:34:02.356293 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-dcadb4f2-6253-4668-98f1-792126955054 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Image pref 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 02:34:02.356742 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-dcadb4f2-6253-4668-98f1-792126955054 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 02:34:02.363036 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2690: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:02.363036 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: user_quotas = model_query(context, models.ProjectUserQuota, Jul 13 02:34:02.367249 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-dcadb4f2-6253-4668-98f1-792126955054 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:02.367702 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-dcadb4f2-6253-4668-98f1-792126955054 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:02.368519 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-dcadb4f2-6253-4668-98f1-792126955054 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:02.368955 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-dcadb4f2-6253-4668-98f1-792126955054 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:02.374059 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/objects/instance.py:1537: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:02.374059 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: project_result = project_query.first() Jul 13 02:34:02.390394 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2708: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:02.390394 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: rows = model_query(context, models.Quota, read_deleted="no").\ Jul 13 02:34:02.395392 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.quota [None req-dcadb4f2-6253-4668-98f1-792126955054 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Getting quotas for project 87e950d1829f4b59a17b88a19be6d5f4. Resources: {'ram', 'cores', 'instances'} {{(pid=107263) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 13 02:34:02.399800 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.quota [None req-dcadb4f2-6253-4668-98f1-792126955054 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Getting quotas for user 1c06f107836d4f8e9b2f99e284e268e1 and project 87e950d1829f4b59a17b88a19be6d5f4. Resources: {'ram', 'cores', 'instances'} {{(pid=107263) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 13 02:34:02.414398 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-dcadb4f2-6253-4668-98f1-792126955054 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Going to run 1 instances... {{(pid=107263) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 13 02:34:02.417046 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-dcadb4f2-6253-4668-98f1-792126955054 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] [instance: 3e123fde-1713-4d31-bb57-f6501b2b56c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a3efd47-3618-4abd-b00b-a9fa9b90b4d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 13 02:34:02.425670 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-4839f92e-d7c8-45f2-9d73-2c2600b42ddd tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:34:02.428967 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:02.428967 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:34:02.437202 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-4839f92e-d7c8-45f2-9d73-2c2600b42ddd tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1554 microversion: 2.1 time: 0.245246 Jul 13 02:34:02.438393 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 478/964] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:34:02 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1554 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:34:02.471317 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-dcadb4f2-6253-4668-98f1-792126955054 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.591284 Jul 13 02:34:02.472446 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 487/965] 10.222.0.32 () {60 vars in 1147 bytes} [Tue Jul 13 02:34:01 2021] POST /compute/v2.1/servers => generated 380 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 02:34:02.481847 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-5c4b48d7-7a67-4cdb-b1b6-00ff1702a2f0 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:34:02.482807 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-5c4b48d7-7a67-4cdb-b1b6-00ff1702a2f0 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] [instance: 3e123fde-1713-4d31-bb57-f6501b2b56c8] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:34:02.567131 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-5c4b48d7-7a67-4cdb-b1b6-00ff1702a2f0 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c06f107836d4f8e9b2f99e284e268e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e950d1829f4b59a17b88a19be6d5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:34:02.569715 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:02.569715 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:34:02.576610 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-5c4b48d7-7a67-4cdb-b1b6-00ff1702a2f0 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] 10.222.0.32 "GET /compute/v2.1/servers/3e123fde-1713-4d31-bb57-f6501b2b56c8" status: 200 len: 1214 microversion: 2.1 time: 0.098346 Jul 13 02:34:02.577489 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 479/966] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:34:02 2021] GET /compute/v2.1/servers/3e123fde-1713-4d31-bb57-f6501b2b56c8 => generated 1214 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:34:03.390441 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [req-04c063f5-02f8-411d-9cf2-d62da5cd2a8b req-b1f35817-a1e5-4430-9ce1-e5c44271f026 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "578a1bf5-b64e-45c5-ac82-32809189a525", "name": "network-vif-deleted", "tag": "bc4abdbb-fe6a-4872-b0b8-aca5ec258475"}]} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:34:03.394652 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:34:03.394652 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: warnings.warn(msg) Jul 13 02:34:03.403876 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-04c063f5-02f8-411d-9cf2-d62da5cd2a8b req-b1f35817-a1e5-4430-9ce1-e5c44271f026 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:03.404049 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-04c063f5-02f8-411d-9cf2-d62da5cd2a8b req-b1f35817-a1e5-4430-9ce1-e5c44271f026 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:03.416475 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.compute.server_external_events [req-04c063f5-02f8-411d-9cf2-d62da5cd2a8b req-b1f35817-a1e5-4430-9ce1-e5c44271f026 service nova] Creating event network-vif-deleted:bc4abdbb-fe6a-4872-b0b8-aca5ec258475 for instance 578a1bf5-b64e-45c5-ac82-32809189a525 on hv-cinder-78102 Jul 13 02:34:03.421582 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [req-04c063f5-02f8-411d-9cf2-d62da5cd2a8b req-b1f35817-a1e5-4430-9ce1-e5c44271f026 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035625 Jul 13 02:34:03.422381 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 488/967] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:34:03 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 02:34:03.454853 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-ac807ff1-f4b3-43ba-86e0-77f654607106 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:34:03.456019 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-ac807ff1-f4b3-43ba-86e0-77f654607106 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:34:03.469411 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ac807ff1-f4b3-43ba-86e0-77f654607106 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:03.469863 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ac807ff1-f4b3-43ba-86e0-77f654607106 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:03.470678 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ac807ff1-f4b3-43ba-86e0-77f654607106 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:03.471217 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ac807ff1-f4b3-43ba-86e0-77f654607106 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:03.474430 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:03.474430 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:34:03.594933 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-108a70a5-8392-4b2d-b033-17ce15e56c6e tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:34:03.596563 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-108a70a5-8392-4b2d-b033-17ce15e56c6e tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] [instance: 3e123fde-1713-4d31-bb57-f6501b2b56c8] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:34:03.605006 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-108a70a5-8392-4b2d-b033-17ce15e56c6e tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:03.605538 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-108a70a5-8392-4b2d-b033-17ce15e56c6e tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:03.606362 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-108a70a5-8392-4b2d-b033-17ce15e56c6e tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:03.606813 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-108a70a5-8392-4b2d-b033-17ce15e56c6e tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:03.607122 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-ac807ff1-f4b3-43ba-86e0-77f654607106 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6963a1e2b294477c9eb4c28dd9348f9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9e51bf2b24e42b7b4bad3a25ff6f564', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:34:03.609902 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:03.609902 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:34:03.610116 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:03.610116 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:34:03.622106 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-ac807ff1-f4b3-43ba-86e0-77f654607106 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 200 len: 1343 microversion: 2.1 time: 0.170874 Jul 13 02:34:03.622837 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 480/968] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:34:03 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 1343 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:34:03.779764 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-108a70a5-8392-4b2d-b033-17ce15e56c6e tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c06f107836d4f8e9b2f99e284e268e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e950d1829f4b59a17b88a19be6d5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:34:03.782529 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:03.782529 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:34:03.796501 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-108a70a5-8392-4b2d-b033-17ce15e56c6e tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] 10.222.0.32 "GET /compute/v2.1/servers/3e123fde-1713-4d31-bb57-f6501b2b56c8" status: 200 len: 1274 microversion: 2.1 time: 0.203774 Jul 13 02:34:03.797549 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 489/969] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:34:03 2021] GET /compute/v2.1/servers/3e123fde-1713-4d31-bb57-f6501b2b56c8 => generated 1274 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:34:04.638881 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-95910faf-01ed-4e64-a7bb-d033cedb43db tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:34:04.640408 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-95910faf-01ed-4e64-a7bb-d033cedb43db tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] [instance: 578a1bf5-b64e-45c5-ac82-32809189a525] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:34:04.647527 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-95910faf-01ed-4e64-a7bb-d033cedb43db tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:04.647967 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-95910faf-01ed-4e64-a7bb-d033cedb43db tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:04.648758 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-95910faf-01ed-4e64-a7bb-d033cedb43db tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:04.649183 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-95910faf-01ed-4e64-a7bb-d033cedb43db tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:04.659154 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:04.659154 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:34:04.706880 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.wsgi [None req-95910faf-01ed-4e64-a7bb-d033cedb43db tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] HTTP exception thrown: Instance 578a1bf5-b64e-45c5-ac82-32809189a525 could not be found. Jul 13 02:34:04.707561 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-95910faf-01ed-4e64-a7bb-d033cedb43db tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Returning 404 to user: Instance 578a1bf5-b64e-45c5-ac82-32809189a525 could not be found. {{(pid=107262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:34:04.708467 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-95910faf-01ed-4e64-a7bb-d033cedb43db tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525" status: 404 len: 111 microversion: 2.1 time: 0.073997 Jul 13 02:34:04.709285 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 481/970] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:34:04 2021] GET /compute/v2.1/servers/578a1bf5-b64e-45c5-ac82-32809189a525 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 02:34:04.716974 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-505576d0-a625-4b8c-8f1a-2ba4f1f98797 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] Calling method '.version_select at 0x7f4312edf940>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:34:04.734820 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-505576d0-a625-4b8c-8f1a-2ba4f1f98797 tempest-TestMinimumBasicScenario-2042876567 tempest-TestMinimumBasicScenario-2042876567-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1376153643" status: 202 len: 0 microversion: 2.1 time: 0.021352 Jul 13 02:34:04.735509 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 490/971] 10.222.0.32 () {58 vars in 1272 bytes} [Tue Jul 13 02:34:04 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1376153643 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:34:04.813766 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-75634854-ff63-4865-96dc-7f449f02f9bf tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:34:04.814388 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-75634854-ff63-4865-96dc-7f449f02f9bf tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] [instance: 3e123fde-1713-4d31-bb57-f6501b2b56c8] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:34:04.821134 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-75634854-ff63-4865-96dc-7f449f02f9bf tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:04.821799 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-75634854-ff63-4865-96dc-7f449f02f9bf tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:04.822812 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-75634854-ff63-4865-96dc-7f449f02f9bf tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:04.823267 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-75634854-ff63-4865-96dc-7f449f02f9bf tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:04.827210 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:04.827210 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:34:05.165005 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-75634854-ff63-4865-96dc-7f449f02f9bf tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c06f107836d4f8e9b2f99e284e268e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e950d1829f4b59a17b88a19be6d5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:34:05.167875 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:05.167875 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:34:05.176351 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-75634854-ff63-4865-96dc-7f449f02f9bf tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] 10.222.0.32 "GET /compute/v2.1/servers/3e123fde-1713-4d31-bb57-f6501b2b56c8" status: 200 len: 1314 microversion: 2.1 time: 0.366205 Jul 13 02:34:05.176921 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 482/972] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:34:04 2021] GET /compute/v2.1/servers/3e123fde-1713-4d31-bb57-f6501b2b56c8 => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:34:05.437944 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [req-a7991fc1-3796-44ce-98f1-e3bd56a01593 req-35eee0e7-e405-4ddb-b19e-786a4afca96a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e123fde-1713-4d31-bb57-f6501b2b56c8", "tag": "8a876fcb-09a2-4819-9a15-b495b5a7b410"}]} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:34:05.439486 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:34:05.439486 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: warnings.warn(msg) Jul 13 02:34:05.447352 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-a7991fc1-3796-44ce-98f1-e3bd56a01593 req-35eee0e7-e405-4ddb-b19e-786a4afca96a service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:05.448032 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-a7991fc1-3796-44ce-98f1-e3bd56a01593 req-35eee0e7-e405-4ddb-b19e-786a4afca96a service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:05.465767 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.compute.server_external_events [req-a7991fc1-3796-44ce-98f1-e3bd56a01593 req-35eee0e7-e405-4ddb-b19e-786a4afca96a service nova] Creating event network-changed:8a876fcb-09a2-4819-9a15-b495b5a7b410 for instance 3e123fde-1713-4d31-bb57-f6501b2b56c8 on hv-cinder-78102 Jul 13 02:34:05.473856 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [req-a7991fc1-3796-44ce-98f1-e3bd56a01593 req-35eee0e7-e405-4ddb-b19e-786a4afca96a service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039185 Jul 13 02:34:05.474664 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 491/973] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:34:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:34:06.192944 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-443b7177-72ff-4674-ac92-1121254adf25 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:34:06.193647 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-443b7177-72ff-4674-ac92-1121254adf25 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] [instance: 3e123fde-1713-4d31-bb57-f6501b2b56c8] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:34:06.199379 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-443b7177-72ff-4674-ac92-1121254adf25 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:06.199829 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-443b7177-72ff-4674-ac92-1121254adf25 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:06.200631 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-443b7177-72ff-4674-ac92-1121254adf25 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:06.201062 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-443b7177-72ff-4674-ac92-1121254adf25 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:06.203938 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:06.203938 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:34:06.598527 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-443b7177-72ff-4674-ac92-1121254adf25 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c06f107836d4f8e9b2f99e284e268e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e950d1829f4b59a17b88a19be6d5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:34:06.601192 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:06.601192 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:34:06.619111 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-443b7177-72ff-4674-ac92-1121254adf25 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] 10.222.0.32 "GET /compute/v2.1/servers/3e123fde-1713-4d31-bb57-f6501b2b56c8" status: 200 len: 1314 microversion: 2.1 time: 0.430414 Jul 13 02:34:06.630140 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 483/974] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:34:06 2021] GET /compute/v2.1/servers/3e123fde-1713-4d31-bb57-f6501b2b56c8 => generated 1314 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:34:07.637032 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-bd41dbdc-afbe-4b47-a7fa-8ce402491754 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:34:07.637987 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-bd41dbdc-afbe-4b47-a7fa-8ce402491754 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] [instance: 3e123fde-1713-4d31-bb57-f6501b2b56c8] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:34:07.645028 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-bd41dbdc-afbe-4b47-a7fa-8ce402491754 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:07.645476 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-bd41dbdc-afbe-4b47-a7fa-8ce402491754 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:07.646287 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-bd41dbdc-afbe-4b47-a7fa-8ce402491754 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:07.646727 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-bd41dbdc-afbe-4b47-a7fa-8ce402491754 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:07.649653 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:07.649653 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:34:07.952885 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-bd41dbdc-afbe-4b47-a7fa-8ce402491754 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c06f107836d4f8e9b2f99e284e268e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e950d1829f4b59a17b88a19be6d5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:34:07.961316 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:07.961316 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:34:07.968298 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-bd41dbdc-afbe-4b47-a7fa-8ce402491754 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] 10.222.0.32 "GET /compute/v2.1/servers/3e123fde-1713-4d31-bb57-f6501b2b56c8" status: 200 len: 1314 microversion: 2.1 time: 0.335270 Jul 13 02:34:07.968891 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 492/975] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:34:07 2021] GET /compute/v2.1/servers/3e123fde-1713-4d31-bb57-f6501b2b56c8 => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:34:08.985784 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-a823bf4d-2b4b-4251-a703-96084436ee66 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:34:08.987010 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-a823bf4d-2b4b-4251-a703-96084436ee66 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] [instance: 3e123fde-1713-4d31-bb57-f6501b2b56c8] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:34:08.993581 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a823bf4d-2b4b-4251-a703-96084436ee66 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:08.994056 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a823bf4d-2b4b-4251-a703-96084436ee66 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:08.994997 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a823bf4d-2b4b-4251-a703-96084436ee66 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:08.995450 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a823bf4d-2b4b-4251-a703-96084436ee66 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:08.999245 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:08.999245 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:34:09.323677 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-a823bf4d-2b4b-4251-a703-96084436ee66 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c06f107836d4f8e9b2f99e284e268e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e950d1829f4b59a17b88a19be6d5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:34:09.326379 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:09.326379 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:34:09.333273 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-a823bf4d-2b4b-4251-a703-96084436ee66 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] 10.222.0.32 "GET /compute/v2.1/servers/3e123fde-1713-4d31-bb57-f6501b2b56c8" status: 200 len: 1314 microversion: 2.1 time: 0.351105 Jul 13 02:34:09.333847 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 484/976] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:34:08 2021] GET /compute/v2.1/servers/3e123fde-1713-4d31-bb57-f6501b2b56c8 => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:34:10.352354 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-72bc2926-3a26-4995-ae81-9a64808924e8 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:34:10.354119 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-72bc2926-3a26-4995-ae81-9a64808924e8 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] [instance: 3e123fde-1713-4d31-bb57-f6501b2b56c8] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:34:10.377591 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-72bc2926-3a26-4995-ae81-9a64808924e8 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:10.377591 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-72bc2926-3a26-4995-ae81-9a64808924e8 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:10.378663 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-72bc2926-3a26-4995-ae81-9a64808924e8 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:10.379212 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-72bc2926-3a26-4995-ae81-9a64808924e8 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:10.382881 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:10.382881 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:34:10.679916 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-72bc2926-3a26-4995-ae81-9a64808924e8 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c06f107836d4f8e9b2f99e284e268e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e950d1829f4b59a17b88a19be6d5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:34:10.682479 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:10.682479 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:34:10.689992 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-72bc2926-3a26-4995-ae81-9a64808924e8 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] 10.222.0.32 "GET /compute/v2.1/servers/3e123fde-1713-4d31-bb57-f6501b2b56c8" status: 200 len: 1314 microversion: 2.1 time: 0.342471 Jul 13 02:34:10.690595 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 493/977] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:34:10 2021] GET /compute/v2.1/servers/3e123fde-1713-4d31-bb57-f6501b2b56c8 => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:34:11.706724 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-4b856d65-55fc-451a-9954-ebc1987b7883 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:34:11.707443 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-4b856d65-55fc-451a-9954-ebc1987b7883 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] [instance: 3e123fde-1713-4d31-bb57-f6501b2b56c8] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:34:11.713839 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-4b856d65-55fc-451a-9954-ebc1987b7883 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:11.714316 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-4b856d65-55fc-451a-9954-ebc1987b7883 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:11.715090 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-4b856d65-55fc-451a-9954-ebc1987b7883 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:11.715521 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-4b856d65-55fc-451a-9954-ebc1987b7883 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:11.718500 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:11.718500 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:34:12.012920 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-4b856d65-55fc-451a-9954-ebc1987b7883 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c06f107836d4f8e9b2f99e284e268e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e950d1829f4b59a17b88a19be6d5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:34:12.016210 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:12.016210 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:34:12.023801 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-4b856d65-55fc-451a-9954-ebc1987b7883 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] 10.222.0.32 "GET /compute/v2.1/servers/3e123fde-1713-4d31-bb57-f6501b2b56c8" status: 200 len: 1314 microversion: 2.1 time: 0.321588 Jul 13 02:34:12.024712 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 485/978] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:34:11 2021] GET /compute/v2.1/servers/3e123fde-1713-4d31-bb57-f6501b2b56c8 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:34:12.899274 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [req-9bba70fd-cd2e-429e-8c6e-7595d8d4fb15 req-a18acca3-ca71-41a1-8046-e9ff9aa538bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e123fde-1713-4d31-bb57-f6501b2b56c8", "name": "network-vif-plugged", "status": "completed", "tag": "8a876fcb-09a2-4819-9a15-b495b5a7b410"}]} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:34:12.901933 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:34:12.901933 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: warnings.warn(msg) Jul 13 02:34:12.912225 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-9bba70fd-cd2e-429e-8c6e-7595d8d4fb15 req-a18acca3-ca71-41a1-8046-e9ff9aa538bf service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:12.912667 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-9bba70fd-cd2e-429e-8c6e-7595d8d4fb15 req-a18acca3-ca71-41a1-8046-e9ff9aa538bf service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:12.924620 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.compute.server_external_events [req-9bba70fd-cd2e-429e-8c6e-7595d8d4fb15 req-a18acca3-ca71-41a1-8046-e9ff9aa538bf service nova] Creating event network-vif-plugged:8a876fcb-09a2-4819-9a15-b495b5a7b410 for instance 3e123fde-1713-4d31-bb57-f6501b2b56c8 on hv-cinder-78102 Jul 13 02:34:12.929859 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [req-9bba70fd-cd2e-429e-8c6e-7595d8d4fb15 req-a18acca3-ca71-41a1-8046-e9ff9aa538bf service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050185 Jul 13 02:34:12.930712 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 494/979] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:34:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:34:13.040392 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-2fcb67a3-a809-47f4-addd-b09454f71648 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:34:13.040996 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-2fcb67a3-a809-47f4-addd-b09454f71648 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] [instance: 3e123fde-1713-4d31-bb57-f6501b2b56c8] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:34:13.047330 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2fcb67a3-a809-47f4-addd-b09454f71648 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:13.047772 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2fcb67a3-a809-47f4-addd-b09454f71648 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:13.048584 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2fcb67a3-a809-47f4-addd-b09454f71648 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:13.049019 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2fcb67a3-a809-47f4-addd-b09454f71648 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:13.052588 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:13.052588 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:34:13.295508 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-2fcb67a3-a809-47f4-addd-b09454f71648 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c06f107836d4f8e9b2f99e284e268e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e950d1829f4b59a17b88a19be6d5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:34:13.298082 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:13.298082 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:34:13.307251 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-2fcb67a3-a809-47f4-addd-b09454f71648 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] 10.222.0.32 "GET /compute/v2.1/servers/3e123fde-1713-4d31-bb57-f6501b2b56c8" status: 200 len: 1314 microversion: 2.1 time: 0.270187 Jul 13 02:34:13.308177 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 486/980] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:34:13 2021] GET /compute/v2.1/servers/3e123fde-1713-4d31-bb57-f6501b2b56c8 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:34:14.324911 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-4e1181a9-5b4a-4633-a05e-00372f7e6e71 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:34:14.325607 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-4e1181a9-5b4a-4633-a05e-00372f7e6e71 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] [instance: 3e123fde-1713-4d31-bb57-f6501b2b56c8] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:34:14.331770 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4e1181a9-5b4a-4633-a05e-00372f7e6e71 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:14.332225 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4e1181a9-5b4a-4633-a05e-00372f7e6e71 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:14.333010 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4e1181a9-5b4a-4633-a05e-00372f7e6e71 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:14.333446 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-4e1181a9-5b4a-4633-a05e-00372f7e6e71 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:14.336659 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:14.336659 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:34:14.521446 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-4e1181a9-5b4a-4633-a05e-00372f7e6e71 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c06f107836d4f8e9b2f99e284e268e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e950d1829f4b59a17b88a19be6d5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:34:14.524300 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:14.524300 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:34:14.531137 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-4e1181a9-5b4a-4633-a05e-00372f7e6e71 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] 10.222.0.32 "GET /compute/v2.1/servers/3e123fde-1713-4d31-bb57-f6501b2b56c8" status: 200 len: 1314 microversion: 2.1 time: 0.210145 Jul 13 02:34:14.534064 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 495/981] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:34:14 2021] GET /compute/v2.1/servers/3e123fde-1713-4d31-bb57-f6501b2b56c8 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:34:15.548217 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-0c7c67ea-9b44-4063-b641-e1632107a0e3 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:34:15.548835 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-0c7c67ea-9b44-4063-b641-e1632107a0e3 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] [instance: 3e123fde-1713-4d31-bb57-f6501b2b56c8] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:34:15.555909 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-0c7c67ea-9b44-4063-b641-e1632107a0e3 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:15.556364 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-0c7c67ea-9b44-4063-b641-e1632107a0e3 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:15.557141 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-0c7c67ea-9b44-4063-b641-e1632107a0e3 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:15.557578 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-0c7c67ea-9b44-4063-b641-e1632107a0e3 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:15.560527 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:15.560527 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:34:15.736115 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-0c7c67ea-9b44-4063-b641-e1632107a0e3 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c06f107836d4f8e9b2f99e284e268e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e950d1829f4b59a17b88a19be6d5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:34:15.739266 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:15.739266 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:34:15.746049 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-0c7c67ea-9b44-4063-b641-e1632107a0e3 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] 10.222.0.32 "GET /compute/v2.1/servers/3e123fde-1713-4d31-bb57-f6501b2b56c8" status: 200 len: 1498 microversion: 2.1 time: 0.201416 Jul 13 02:34:15.746611 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 487/982] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:34:15 2021] GET /compute/v2.1/servers/3e123fde-1713-4d31-bb57-f6501b2b56c8 => generated 1498 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:34:16.347872 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-91b5be3b-20af-48b2-9ba8-ed30aa3b9904 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:34:16.348419 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-91b5be3b-20af-48b2-9ba8-ed30aa3b9904 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] [instance: 3e123fde-1713-4d31-bb57-f6501b2b56c8] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:34:16.354605 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-91b5be3b-20af-48b2-9ba8-ed30aa3b9904 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:16.355116 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-91b5be3b-20af-48b2-9ba8-ed30aa3b9904 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:16.355956 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-91b5be3b-20af-48b2-9ba8-ed30aa3b9904 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:16.356390 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-91b5be3b-20af-48b2-9ba8-ed30aa3b9904 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:16.359232 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:16.359232 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:34:16.423707 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-91b5be3b-20af-48b2-9ba8-ed30aa3b9904 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] [instance: 3e123fde-1713-4d31-bb57-f6501b2b56c8] Going to try to terminate instance {{(pid=107263) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 13 02:34:16.426419 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3008: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:16.426419 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).\ Jul 13 02:34:16.438773 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:16.438773 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:34:16.497927 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/update_match.py:472: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:16.497927 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = query.session.execute(update_stmt) Jul 13 02:34:16.512165 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:530: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:16.512165 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = model_query(context, models.Service, read_deleted="no").\ Jul 13 02:34:16.543003 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-91b5be3b-20af-48b2-9ba8-ed30aa3b9904 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] 10.222.0.32 "DELETE /compute/v2.1/servers/3e123fde-1713-4d31-bb57-f6501b2b56c8" status: 204 len: 0 microversion: 2.1 time: 0.199390 Jul 13 02:34:16.543588 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 496/983] 10.222.0.32 () {58 vars in 1239 bytes} [Tue Jul 13 02:34:16 2021] DELETE /compute/v2.1/servers/3e123fde-1713-4d31-bb57-f6501b2b56c8 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 13 02:34:16.551891 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-9ac67dbb-3b52-4ad5-a314-c0b9f6065488 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:34:16.552496 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-9ac67dbb-3b52-4ad5-a314-c0b9f6065488 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] [instance: 3e123fde-1713-4d31-bb57-f6501b2b56c8] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:34:16.558251 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9ac67dbb-3b52-4ad5-a314-c0b9f6065488 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:16.558696 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9ac67dbb-3b52-4ad5-a314-c0b9f6065488 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:16.559453 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9ac67dbb-3b52-4ad5-a314-c0b9f6065488 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:16.559882 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9ac67dbb-3b52-4ad5-a314-c0b9f6065488 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:16.562719 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:16.562719 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:34:16.736608 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-9ac67dbb-3b52-4ad5-a314-c0b9f6065488 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c06f107836d4f8e9b2f99e284e268e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e950d1829f4b59a17b88a19be6d5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:34:16.739274 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:16.739274 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:34:16.746079 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-9ac67dbb-3b52-4ad5-a314-c0b9f6065488 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] 10.222.0.32 "GET /compute/v2.1/servers/3e123fde-1713-4d31-bb57-f6501b2b56c8" status: 200 len: 1504 microversion: 2.1 time: 0.197911 Jul 13 02:34:16.746645 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 488/984] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:34:16 2021] GET /compute/v2.1/servers/3e123fde-1713-4d31-bb57-f6501b2b56c8 => generated 1504 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:34:17.763702 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-723778fb-f915-49e5-aa82-7bc6ce4b4ac8 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:34:17.764398 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-723778fb-f915-49e5-aa82-7bc6ce4b4ac8 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] [instance: 3e123fde-1713-4d31-bb57-f6501b2b56c8] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:34:17.770253 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-723778fb-f915-49e5-aa82-7bc6ce4b4ac8 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:17.770703 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-723778fb-f915-49e5-aa82-7bc6ce4b4ac8 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:17.771464 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-723778fb-f915-49e5-aa82-7bc6ce4b4ac8 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:17.771899 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-723778fb-f915-49e5-aa82-7bc6ce4b4ac8 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:17.774712 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:17.774712 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:34:17.957424 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-723778fb-f915-49e5-aa82-7bc6ce4b4ac8 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c06f107836d4f8e9b2f99e284e268e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e950d1829f4b59a17b88a19be6d5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:34:17.960028 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:17.960028 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:34:17.966990 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-723778fb-f915-49e5-aa82-7bc6ce4b4ac8 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] 10.222.0.32 "GET /compute/v2.1/servers/3e123fde-1713-4d31-bb57-f6501b2b56c8" status: 200 len: 1504 microversion: 2.1 time: 0.207576 Jul 13 02:34:17.967862 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 497/985] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:34:17 2021] GET /compute/v2.1/servers/3e123fde-1713-4d31-bb57-f6501b2b56c8 => generated 1504 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:34:18.554289 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-c235733b-f3be-4046-ac02-8834d9701402 req-c0456559-9a1b-4c94-ac67-48f306d43894 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e123fde-1713-4d31-bb57-f6501b2b56c8", "name": "network-vif-deleted", "tag": "8a876fcb-09a2-4819-9a15-b495b5a7b410"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:34:18.556035 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:34:18.556035 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:34:18.563452 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-c235733b-f3be-4046-ac02-8834d9701402 req-c0456559-9a1b-4c94-ac67-48f306d43894 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:18.563894 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-c235733b-f3be-4046-ac02-8834d9701402 req-c0456559-9a1b-4c94-ac67-48f306d43894 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:18.578907 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-c235733b-f3be-4046-ac02-8834d9701402 req-c0456559-9a1b-4c94-ac67-48f306d43894 service nova] Creating event network-vif-deleted:8a876fcb-09a2-4819-9a15-b495b5a7b410 for instance 3e123fde-1713-4d31-bb57-f6501b2b56c8 on hv-cinder-78102 Jul 13 02:34:18.585111 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-c235733b-f3be-4046-ac02-8834d9701402 req-c0456559-9a1b-4c94-ac67-48f306d43894 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034427 Jul 13 02:34:18.585741 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 489/986] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:34:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:34:18.984575 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-06ea2a2e-6deb-4bf2-92be-00f8e4392509 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:34:18.985183 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-06ea2a2e-6deb-4bf2-92be-00f8e4392509 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] [instance: 3e123fde-1713-4d31-bb57-f6501b2b56c8] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:34:18.991627 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-06ea2a2e-6deb-4bf2-92be-00f8e4392509 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:18.992074 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-06ea2a2e-6deb-4bf2-92be-00f8e4392509 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:18.992834 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-06ea2a2e-6deb-4bf2-92be-00f8e4392509 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:18.993269 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-06ea2a2e-6deb-4bf2-92be-00f8e4392509 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:18.996110 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:18.996110 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:34:19.077523 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-06ea2a2e-6deb-4bf2-92be-00f8e4392509 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:19.077968 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-06ea2a2e-6deb-4bf2-92be-00f8e4392509 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:19.078436 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.objects.instance [None req-06ea2a2e-6deb-4bf2-92be-00f8e4392509 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lazy-loading 'fault' on Instance uuid 3e123fde-1713-4d31-bb57-f6501b2b56c8 {{(pid=107263) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 13 02:34:19.080871 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:4002: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:19.080871 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: for row in query: Jul 13 02:34:19.125449 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-06ea2a2e-6deb-4bf2-92be-00f8e4392509 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c06f107836d4f8e9b2f99e284e268e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e950d1829f4b59a17b88a19be6d5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:34:19.128796 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:19.128796 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:34:19.135740 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-06ea2a2e-6deb-4bf2-92be-00f8e4392509 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] 10.222.0.32 "GET /compute/v2.1/servers/3e123fde-1713-4d31-bb57-f6501b2b56c8" status: 200 len: 1304 microversion: 2.1 time: 0.154864 Jul 13 02:34:19.136305 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 498/987] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:34:18 2021] GET /compute/v2.1/servers/3e123fde-1713-4d31-bb57-f6501b2b56c8 => generated 1304 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:34:20.153717 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-2623961b-26ed-4c48-8c42-bb26fe591a36 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:34:20.154440 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-2623961b-26ed-4c48-8c42-bb26fe591a36 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] [instance: 3e123fde-1713-4d31-bb57-f6501b2b56c8] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:34:20.160533 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2623961b-26ed-4c48-8c42-bb26fe591a36 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:20.160976 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2623961b-26ed-4c48-8c42-bb26fe591a36 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:20.161738 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2623961b-26ed-4c48-8c42-bb26fe591a36 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:20.162200 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2623961b-26ed-4c48-8c42-bb26fe591a36 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:20.165019 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:20.165019 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:34:20.209044 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.wsgi [None req-2623961b-26ed-4c48-8c42-bb26fe591a36 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] HTTP exception thrown: Instance 3e123fde-1713-4d31-bb57-f6501b2b56c8 could not be found. Jul 13 02:34:20.209618 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-2623961b-26ed-4c48-8c42-bb26fe591a36 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Returning 404 to user: Instance 3e123fde-1713-4d31-bb57-f6501b2b56c8 could not be found. {{(pid=107262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:34:20.210462 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-2623961b-26ed-4c48-8c42-bb26fe591a36 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] 10.222.0.32 "GET /compute/v2.1/servers/3e123fde-1713-4d31-bb57-f6501b2b56c8" status: 404 len: 111 microversion: 2.1 time: 0.060761 Jul 13 02:34:20.210995 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 490/988] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:34:20 2021] GET /compute/v2.1/servers/3e123fde-1713-4d31-bb57-f6501b2b56c8 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 02:34:20.303392 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-997ccd7c-2257-4529-a30e-af30dba16169 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1778179882", "imageRef": "1a3efd47-3618-4abd-b00b-a9fa9b90b4d4", "flavorRef": "452", "networks": [{"uuid": "fe7fb172-0d2b-4b8e-9cdf-93d66698e34c"}]}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:34:20.363681 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.network.neutron [None req-997ccd7c-2257-4529-a30e-af30dba16169 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] validate_networks() for [('fe7fb172-0d2b-4b8e-9cdf-93d66698e34c', None, None, None)] {{(pid=107263) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Jul 13 02:34:20.702634 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-997ccd7c-2257-4529-a30e-af30dba16169 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Flavor limits 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 02:34:20.703062 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-997ccd7c-2257-4529-a30e-af30dba16169 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Image limits 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 02:34:20.703535 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-997ccd7c-2257-4529-a30e-af30dba16169 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Flavor pref 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 02:34:20.703948 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-997ccd7c-2257-4529-a30e-af30dba16169 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Image pref 0:0:0 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 02:34:20.704359 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.virt.hardware [None req-997ccd7c-2257-4529-a30e-af30dba16169 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107263) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 02:34:20.710326 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2690: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:20.710326 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: user_quotas = model_query(context, models.ProjectUserQuota, Jul 13 02:34:20.714715 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-997ccd7c-2257-4529-a30e-af30dba16169 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:20.715167 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-997ccd7c-2257-4529-a30e-af30dba16169 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:20.715973 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-997ccd7c-2257-4529-a30e-af30dba16169 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:20.716409 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-997ccd7c-2257-4529-a30e-af30dba16169 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:20.721086 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/objects/instance.py:1537: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:20.721086 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: project_result = project_query.first() Jul 13 02:34:20.733202 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2708: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:20.733202 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: rows = model_query(context, models.Quota, read_deleted="no").\ Jul 13 02:34:20.737303 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.quota [None req-997ccd7c-2257-4529-a30e-af30dba16169 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Getting quotas for project 87e950d1829f4b59a17b88a19be6d5f4. Resources: {'ram', 'cores', 'instances'} {{(pid=107263) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 13 02:34:20.741238 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.quota [None req-997ccd7c-2257-4529-a30e-af30dba16169 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Getting quotas for user 1c06f107836d4f8e9b2f99e284e268e1 and project 87e950d1829f4b59a17b88a19be6d5f4. Resources: {'ram', 'cores', 'instances'} {{(pid=107263) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 13 02:34:20.753285 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-997ccd7c-2257-4529-a30e-af30dba16169 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Going to run 1 instances... {{(pid=107263) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 13 02:34:20.755665 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-997ccd7c-2257-4529-a30e-af30dba16169 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] [instance: 0af72798-5465-4a26-9734-daa2b0dc9af8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a3efd47-3618-4abd-b00b-a9fa9b90b4d4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=107263) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 13 02:34:20.800880 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-997ccd7c-2257-4529-a30e-af30dba16169 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.501772 Jul 13 02:34:20.801686 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 499/989] 10.222.0.32 () {60 vars in 1147 bytes} [Tue Jul 13 02:34:20 2021] POST /compute/v2.1/servers => generated 380 bytes in 503 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 02:34:20.811466 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-cb4b674f-eb64-4457-83a9-195815c92847 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:34:20.812117 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-cb4b674f-eb64-4457-83a9-195815c92847 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] [instance: 0af72798-5465-4a26-9734-daa2b0dc9af8] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:34:20.866752 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-cb4b674f-eb64-4457-83a9-195815c92847 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c06f107836d4f8e9b2f99e284e268e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e950d1829f4b59a17b88a19be6d5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:34:20.869321 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:20.869321 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:34:20.875626 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-cb4b674f-eb64-4457-83a9-195815c92847 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] 10.222.0.32 "GET /compute/v2.1/servers/0af72798-5465-4a26-9734-daa2b0dc9af8" status: 200 len: 1214 microversion: 2.1 time: 0.067591 Jul 13 02:34:20.885043 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 491/990] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:34:20 2021] GET /compute/v2.1/servers/0af72798-5465-4a26-9734-daa2b0dc9af8 => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:34:21.892368 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-1fe250c9-266d-4e82-80be-26a8741d7380 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:34:21.893868 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-1fe250c9-266d-4e82-80be-26a8741d7380 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] [instance: 0af72798-5465-4a26-9734-daa2b0dc9af8] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:34:21.900381 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-1fe250c9-266d-4e82-80be-26a8741d7380 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:21.900940 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-1fe250c9-266d-4e82-80be-26a8741d7380 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:21.901832 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-1fe250c9-266d-4e82-80be-26a8741d7380 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:21.902359 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-1fe250c9-266d-4e82-80be-26a8741d7380 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:21.905453 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:21.905453 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:34:22.036911 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-1fe250c9-266d-4e82-80be-26a8741d7380 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c06f107836d4f8e9b2f99e284e268e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e950d1829f4b59a17b88a19be6d5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:34:22.039560 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:22.039560 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:34:22.046739 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-1fe250c9-266d-4e82-80be-26a8741d7380 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] 10.222.0.32 "GET /compute/v2.1/servers/0af72798-5465-4a26-9734-daa2b0dc9af8" status: 200 len: 1274 microversion: 2.1 time: 0.158031 Jul 13 02:34:22.047542 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 500/991] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:34:21 2021] GET /compute/v2.1/servers/0af72798-5465-4a26-9734-daa2b0dc9af8 => generated 1274 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:34:23.065297 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-2616119f-4bdc-4073-bf67-31074af87db4 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:34:23.066596 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-2616119f-4bdc-4073-bf67-31074af87db4 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] [instance: 0af72798-5465-4a26-9734-daa2b0dc9af8] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:34:23.077129 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2616119f-4bdc-4073-bf67-31074af87db4 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:23.077573 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2616119f-4bdc-4073-bf67-31074af87db4 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:23.078404 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2616119f-4bdc-4073-bf67-31074af87db4 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:23.078835 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2616119f-4bdc-4073-bf67-31074af87db4 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:23.082961 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:23.082961 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:34:23.200182 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [req-9b19bdab-e20a-45e9-a101-dce2fb62ae2b req-ce399965-3c33-43ec-bf37-67b0afb55a82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0af72798-5465-4a26-9734-daa2b0dc9af8", "tag": "eb513516-a7d8-4c7b-91a1-867dea7bf19d"}]} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:34:23.201862 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:34:23.201862 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: warnings.warn(msg) Jul 13 02:34:23.209431 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-9b19bdab-e20a-45e9-a101-dce2fb62ae2b req-ce399965-3c33-43ec-bf37-67b0afb55a82 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:23.209957 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-9b19bdab-e20a-45e9-a101-dce2fb62ae2b req-ce399965-3c33-43ec-bf37-67b0afb55a82 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:23.222060 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.compute.server_external_events [req-9b19bdab-e20a-45e9-a101-dce2fb62ae2b req-ce399965-3c33-43ec-bf37-67b0afb55a82 service nova] Creating event network-changed:eb513516-a7d8-4c7b-91a1-867dea7bf19d for instance 0af72798-5465-4a26-9734-daa2b0dc9af8 on hv-cinder-78102 Jul 13 02:34:23.228107 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [req-9b19bdab-e20a-45e9-a101-dce2fb62ae2b req-ce399965-3c33-43ec-bf37-67b0afb55a82 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033162 Jul 13 02:34:23.228799 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 501/992] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:34:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 02:34:23.352004 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-2616119f-4bdc-4073-bf67-31074af87db4 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c06f107836d4f8e9b2f99e284e268e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e950d1829f4b59a17b88a19be6d5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:34:23.354575 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:23.354575 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:34:23.362183 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-2616119f-4bdc-4073-bf67-31074af87db4 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] 10.222.0.32 "GET /compute/v2.1/servers/0af72798-5465-4a26-9734-daa2b0dc9af8" status: 200 len: 1314 microversion: 2.1 time: 0.300635 Jul 13 02:34:23.362771 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 492/993] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:34:23 2021] GET /compute/v2.1/servers/0af72798-5465-4a26-9734-daa2b0dc9af8 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:34:24.379525 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-edf774d7-9a69-4cd0-b804-fd2269419006 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:34:24.380134 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-edf774d7-9a69-4cd0-b804-fd2269419006 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] [instance: 0af72798-5465-4a26-9734-daa2b0dc9af8] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:34:24.386327 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-edf774d7-9a69-4cd0-b804-fd2269419006 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:24.386774 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-edf774d7-9a69-4cd0-b804-fd2269419006 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:24.387791 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-edf774d7-9a69-4cd0-b804-fd2269419006 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:24.388225 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-edf774d7-9a69-4cd0-b804-fd2269419006 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:24.391087 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:24.391087 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:34:24.575077 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-edf774d7-9a69-4cd0-b804-fd2269419006 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c06f107836d4f8e9b2f99e284e268e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e950d1829f4b59a17b88a19be6d5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:34:24.577645 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:24.577645 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:34:24.584922 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-edf774d7-9a69-4cd0-b804-fd2269419006 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] 10.222.0.32 "GET /compute/v2.1/servers/0af72798-5465-4a26-9734-daa2b0dc9af8" status: 200 len: 1314 microversion: 2.1 time: 0.209555 Jul 13 02:34:24.585485 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 502/994] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:34:24 2021] GET /compute/v2.1/servers/0af72798-5465-4a26-9734-daa2b0dc9af8 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:34:25.601668 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-0d43ebd5-8298-452e-8031-1e9bb0c588aa tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:34:25.602226 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-0d43ebd5-8298-452e-8031-1e9bb0c588aa tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] [instance: 0af72798-5465-4a26-9734-daa2b0dc9af8] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:34:25.607999 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-0d43ebd5-8298-452e-8031-1e9bb0c588aa tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:25.608440 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-0d43ebd5-8298-452e-8031-1e9bb0c588aa tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:25.609197 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-0d43ebd5-8298-452e-8031-1e9bb0c588aa tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:25.609626 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-0d43ebd5-8298-452e-8031-1e9bb0c588aa tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:25.612480 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:25.612480 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:34:26.072803 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-0d43ebd5-8298-452e-8031-1e9bb0c588aa tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c06f107836d4f8e9b2f99e284e268e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e950d1829f4b59a17b88a19be6d5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:34:26.075483 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:26.075483 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:34:26.082875 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-0d43ebd5-8298-452e-8031-1e9bb0c588aa tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] 10.222.0.32 "GET /compute/v2.1/servers/0af72798-5465-4a26-9734-daa2b0dc9af8" status: 200 len: 1314 microversion: 2.1 time: 0.484819 Jul 13 02:34:26.083460 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 493/995] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:34:25 2021] GET /compute/v2.1/servers/0af72798-5465-4a26-9734-daa2b0dc9af8 => generated 1314 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:34:27.100348 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-0d7fddd6-ca6c-4961-a250-4122d924062a tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:34:27.100957 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-0d7fddd6-ca6c-4961-a250-4122d924062a tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] [instance: 0af72798-5465-4a26-9734-daa2b0dc9af8] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:34:27.106792 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0d7fddd6-ca6c-4961-a250-4122d924062a tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:27.107236 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0d7fddd6-ca6c-4961-a250-4122d924062a tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:27.107984 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0d7fddd6-ca6c-4961-a250-4122d924062a tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:27.108413 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-0d7fddd6-ca6c-4961-a250-4122d924062a tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:27.112336 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:27.112336 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:34:27.291692 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-0d7fddd6-ca6c-4961-a250-4122d924062a tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c06f107836d4f8e9b2f99e284e268e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e950d1829f4b59a17b88a19be6d5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:34:27.294371 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:27.294371 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:34:27.302951 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-0d7fddd6-ca6c-4961-a250-4122d924062a tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] 10.222.0.32 "GET /compute/v2.1/servers/0af72798-5465-4a26-9734-daa2b0dc9af8" status: 200 len: 1314 microversion: 2.1 time: 0.207187 Jul 13 02:34:27.303537 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 503/996] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:34:27 2021] GET /compute/v2.1/servers/0af72798-5465-4a26-9734-daa2b0dc9af8 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:34:28.319549 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-18c2bcef-70bd-4741-883f-c5ca9202cc69 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:34:28.320126 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-18c2bcef-70bd-4741-883f-c5ca9202cc69 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] [instance: 0af72798-5465-4a26-9734-daa2b0dc9af8] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:34:28.325880 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-18c2bcef-70bd-4741-883f-c5ca9202cc69 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:28.326362 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-18c2bcef-70bd-4741-883f-c5ca9202cc69 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:28.327116 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-18c2bcef-70bd-4741-883f-c5ca9202cc69 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:28.327564 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-18c2bcef-70bd-4741-883f-c5ca9202cc69 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:28.330523 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:28.330523 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:34:28.655863 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-18c2bcef-70bd-4741-883f-c5ca9202cc69 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c06f107836d4f8e9b2f99e284e268e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e950d1829f4b59a17b88a19be6d5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:34:28.658663 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:28.658663 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:34:28.665755 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-18c2bcef-70bd-4741-883f-c5ca9202cc69 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] 10.222.0.32 "GET /compute/v2.1/servers/0af72798-5465-4a26-9734-daa2b0dc9af8" status: 200 len: 1314 microversion: 2.1 time: 0.349958 Jul 13 02:34:28.666359 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 494/997] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:34:28 2021] GET /compute/v2.1/servers/0af72798-5465-4a26-9734-daa2b0dc9af8 => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:34:28.912834 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [req-62d8c599-5719-4347-a28c-46f923274ec0 req-be0cbe54-b5af-4229-91bc-c801656ce433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0af72798-5465-4a26-9734-daa2b0dc9af8", "name": "network-vif-plugged", "status": "completed", "tag": "eb513516-a7d8-4c7b-91a1-867dea7bf19d"}]} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:34:28.914438 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:34:28.914438 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: warnings.warn(msg) Jul 13 02:34:28.921316 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-62d8c599-5719-4347-a28c-46f923274ec0 req-be0cbe54-b5af-4229-91bc-c801656ce433 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:28.921756 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-62d8c599-5719-4347-a28c-46f923274ec0 req-be0cbe54-b5af-4229-91bc-c801656ce433 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:28.932515 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.compute.server_external_events [req-62d8c599-5719-4347-a28c-46f923274ec0 req-be0cbe54-b5af-4229-91bc-c801656ce433 service nova] Creating event network-vif-plugged:eb513516-a7d8-4c7b-91a1-867dea7bf19d for instance 0af72798-5465-4a26-9734-daa2b0dc9af8 on hv-cinder-78102 Jul 13 02:34:28.937175 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [req-62d8c599-5719-4347-a28c-46f923274ec0 req-be0cbe54-b5af-4229-91bc-c801656ce433 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028084 Jul 13 02:34:28.937753 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 504/998] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:34:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 02:34:29.682717 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-ebfb84a3-76b7-48c1-900a-51977db1ed87 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:34:29.683319 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-ebfb84a3-76b7-48c1-900a-51977db1ed87 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] [instance: 0af72798-5465-4a26-9734-daa2b0dc9af8] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:34:29.689024 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ebfb84a3-76b7-48c1-900a-51977db1ed87 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:29.690111 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ebfb84a3-76b7-48c1-900a-51977db1ed87 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:29.691026 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ebfb84a3-76b7-48c1-900a-51977db1ed87 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:29.691453 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ebfb84a3-76b7-48c1-900a-51977db1ed87 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:29.694270 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:29.694270 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:34:29.862545 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-ebfb84a3-76b7-48c1-900a-51977db1ed87 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c06f107836d4f8e9b2f99e284e268e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e950d1829f4b59a17b88a19be6d5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:34:29.865044 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:29.865044 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:34:29.871893 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-ebfb84a3-76b7-48c1-900a-51977db1ed87 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] 10.222.0.32 "GET /compute/v2.1/servers/0af72798-5465-4a26-9734-daa2b0dc9af8" status: 200 len: 1314 microversion: 2.1 time: 0.192746 Jul 13 02:34:29.872440 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 495/999] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:34:29 2021] GET /compute/v2.1/servers/0af72798-5465-4a26-9734-daa2b0dc9af8 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:34:30.889366 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-6dfba6e7-4941-4e91-99e9-1da700c1e3f8 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:34:30.889989 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-6dfba6e7-4941-4e91-99e9-1da700c1e3f8 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] [instance: 0af72798-5465-4a26-9734-daa2b0dc9af8] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:34:30.896652 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6dfba6e7-4941-4e91-99e9-1da700c1e3f8 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:30.897104 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6dfba6e7-4941-4e91-99e9-1da700c1e3f8 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:30.897872 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6dfba6e7-4941-4e91-99e9-1da700c1e3f8 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:30.898338 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6dfba6e7-4941-4e91-99e9-1da700c1e3f8 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:30.901204 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:30.901204 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:34:31.074898 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-6dfba6e7-4941-4e91-99e9-1da700c1e3f8 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c06f107836d4f8e9b2f99e284e268e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e950d1829f4b59a17b88a19be6d5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:34:31.078051 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:31.078051 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:34:31.085755 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-6dfba6e7-4941-4e91-99e9-1da700c1e3f8 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] 10.222.0.32 "GET /compute/v2.1/servers/0af72798-5465-4a26-9734-daa2b0dc9af8" status: 200 len: 1499 microversion: 2.1 time: 0.200803 Jul 13 02:34:31.086347 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 505/1000] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:34:30 2021] GET /compute/v2.1/servers/0af72798-5465-4a26-9734-daa2b0dc9af8 => generated 1499 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:34:31.692057 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-610d7072-3531-47eb-bdab-35426c1b4533 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:34:31.692577 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-610d7072-3531-47eb-bdab-35426c1b4533 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] [instance: 0af72798-5465-4a26-9734-daa2b0dc9af8] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:34:31.698288 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-610d7072-3531-47eb-bdab-35426c1b4533 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:31.698738 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-610d7072-3531-47eb-bdab-35426c1b4533 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:31.699509 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-610d7072-3531-47eb-bdab-35426c1b4533 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:31.699963 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-610d7072-3531-47eb-bdab-35426c1b4533 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:31.702788 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:31.702788 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:34:31.765101 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-610d7072-3531-47eb-bdab-35426c1b4533 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] [instance: 0af72798-5465-4a26-9734-daa2b0dc9af8] Going to try to terminate instance {{(pid=107262) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 13 02:34:31.767492 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3008: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:31.767492 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).\ Jul 13 02:34:31.780128 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:31.780128 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:34:31.835988 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/update_match.py:472: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:31.835988 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = query.session.execute(update_stmt) Jul 13 02:34:31.851081 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:530: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:31.851081 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = model_query(context, models.Service, read_deleted="no").\ Jul 13 02:34:31.885308 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-610d7072-3531-47eb-bdab-35426c1b4533 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] 10.222.0.32 "DELETE /compute/v2.1/servers/0af72798-5465-4a26-9734-daa2b0dc9af8" status: 204 len: 0 microversion: 2.1 time: 0.196837 Jul 13 02:34:31.885482 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 496/1001] 10.222.0.32 () {58 vars in 1239 bytes} [Tue Jul 13 02:34:31 2021] DELETE /compute/v2.1/servers/0af72798-5465-4a26-9734-daa2b0dc9af8 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 13 02:34:31.893698 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-05da1216-b0de-4fd9-894d-ff85d1b5e965 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:34:31.894331 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-05da1216-b0de-4fd9-894d-ff85d1b5e965 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] [instance: 0af72798-5465-4a26-9734-daa2b0dc9af8] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:34:31.904355 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-05da1216-b0de-4fd9-894d-ff85d1b5e965 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:31.904802 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-05da1216-b0de-4fd9-894d-ff85d1b5e965 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:31.905570 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-05da1216-b0de-4fd9-894d-ff85d1b5e965 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:31.906000 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-05da1216-b0de-4fd9-894d-ff85d1b5e965 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:31.909187 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:31.909187 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:34:32.085570 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-05da1216-b0de-4fd9-894d-ff85d1b5e965 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c06f107836d4f8e9b2f99e284e268e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e950d1829f4b59a17b88a19be6d5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:34:32.088157 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:32.088157 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:34:32.094931 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-05da1216-b0de-4fd9-894d-ff85d1b5e965 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] 10.222.0.32 "GET /compute/v2.1/servers/0af72798-5465-4a26-9734-daa2b0dc9af8" status: 200 len: 1505 microversion: 2.1 time: 0.205063 Jul 13 02:34:32.095621 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 506/1002] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:34:31 2021] GET /compute/v2.1/servers/0af72798-5465-4a26-9734-daa2b0dc9af8 => generated 1505 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:34:33.112398 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-a645a5e5-4008-4306-a2c8-8227127b9feb tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:34:33.113095 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-a645a5e5-4008-4306-a2c8-8227127b9feb tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] [instance: 0af72798-5465-4a26-9734-daa2b0dc9af8] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:34:33.118809 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a645a5e5-4008-4306-a2c8-8227127b9feb tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:33.119249 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a645a5e5-4008-4306-a2c8-8227127b9feb tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:33.120003 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a645a5e5-4008-4306-a2c8-8227127b9feb tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:33.120428 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a645a5e5-4008-4306-a2c8-8227127b9feb tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:33.123243 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:33.123243 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:34:33.300707 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-a645a5e5-4008-4306-a2c8-8227127b9feb tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c06f107836d4f8e9b2f99e284e268e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e950d1829f4b59a17b88a19be6d5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:34:33.303236 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:33.303236 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:34:33.311095 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-a645a5e5-4008-4306-a2c8-8227127b9feb tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] 10.222.0.32 "GET /compute/v2.1/servers/0af72798-5465-4a26-9734-daa2b0dc9af8" status: 200 len: 1505 microversion: 2.1 time: 0.203075 Jul 13 02:34:33.311820 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 497/1003] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:34:33 2021] GET /compute/v2.1/servers/0af72798-5465-4a26-9734-daa2b0dc9af8 => generated 1505 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:34:34.086251 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [req-a24c2639-042e-46d8-bcb3-342ad170be6f req-76484da3-2df8-4b7b-8a07-d72a1462c8c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0af72798-5465-4a26-9734-daa2b0dc9af8", "name": "network-vif-deleted", "tag": "eb513516-a7d8-4c7b-91a1-867dea7bf19d"}]} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:34:34.088157 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:34:34.088157 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: warnings.warn(msg) Jul 13 02:34:34.097314 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-a24c2639-042e-46d8-bcb3-342ad170be6f req-76484da3-2df8-4b7b-8a07-d72a1462c8c9 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:34.097758 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-a24c2639-042e-46d8-bcb3-342ad170be6f req-76484da3-2df8-4b7b-8a07-d72a1462c8c9 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:34.112676 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.compute.server_external_events [req-a24c2639-042e-46d8-bcb3-342ad170be6f req-76484da3-2df8-4b7b-8a07-d72a1462c8c9 service nova] Creating event network-vif-deleted:eb513516-a7d8-4c7b-91a1-867dea7bf19d for instance 0af72798-5465-4a26-9734-daa2b0dc9af8 on hv-cinder-78102 Jul 13 02:34:34.119305 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [req-a24c2639-042e-46d8-bcb3-342ad170be6f req-76484da3-2df8-4b7b-8a07-d72a1462c8c9 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036813 Jul 13 02:34:34.120003 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 507/1004] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:34:34 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:34:34.328690 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-d630e9d1-6fae-47e7-a365-2651a578fcce tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:34:34.329338 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-d630e9d1-6fae-47e7-a365-2651a578fcce tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] [instance: 0af72798-5465-4a26-9734-daa2b0dc9af8] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:34:34.336440 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d630e9d1-6fae-47e7-a365-2651a578fcce tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:34.336889 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d630e9d1-6fae-47e7-a365-2651a578fcce tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:34.337672 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d630e9d1-6fae-47e7-a365-2651a578fcce tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:34.338144 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d630e9d1-6fae-47e7-a365-2651a578fcce tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:34.341017 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:34.341017 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:34:34.416049 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d630e9d1-6fae-47e7-a365-2651a578fcce tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:34.416502 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d630e9d1-6fae-47e7-a365-2651a578fcce tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:34.416942 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.objects.instance [None req-d630e9d1-6fae-47e7-a365-2651a578fcce tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lazy-loading 'fault' on Instance uuid 0af72798-5465-4a26-9734-daa2b0dc9af8 {{(pid=107262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 13 02:34:34.418943 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:4002: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:34.418943 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: for row in query: Jul 13 02:34:34.461282 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-d630e9d1-6fae-47e7-a365-2651a578fcce tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c06f107836d4f8e9b2f99e284e268e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87e950d1829f4b59a17b88a19be6d5f4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:34:34.463805 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:34.463805 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:34:34.470723 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-d630e9d1-6fae-47e7-a365-2651a578fcce tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] 10.222.0.32 "GET /compute/v2.1/servers/0af72798-5465-4a26-9734-daa2b0dc9af8" status: 200 len: 1304 microversion: 2.1 time: 0.146055 Jul 13 02:34:34.471293 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 498/1005] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:34:34 2021] GET /compute/v2.1/servers/0af72798-5465-4a26-9734-daa2b0dc9af8 => generated 1304 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:34:35.488968 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-77862d8a-27a2-478f-a948-a6dddd6688a1 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:34:35.489656 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-77862d8a-27a2-478f-a948-a6dddd6688a1 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] [instance: 0af72798-5465-4a26-9734-daa2b0dc9af8] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:34:35.495550 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-77862d8a-27a2-478f-a948-a6dddd6688a1 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:35.495988 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-77862d8a-27a2-478f-a948-a6dddd6688a1 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:35.496798 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-77862d8a-27a2-478f-a948-a6dddd6688a1 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:35.497230 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-77862d8a-27a2-478f-a948-a6dddd6688a1 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:35.500150 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:35.500150 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:34:35.547051 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.wsgi [None req-77862d8a-27a2-478f-a948-a6dddd6688a1 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] HTTP exception thrown: Instance 0af72798-5465-4a26-9734-daa2b0dc9af8 could not be found. Jul 13 02:34:35.547651 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-77862d8a-27a2-478f-a948-a6dddd6688a1 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] Returning 404 to user: Instance 0af72798-5465-4a26-9734-daa2b0dc9af8 could not be found. {{(pid=107263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:34:35.548653 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-77862d8a-27a2-478f-a948-a6dddd6688a1 tempest-VolumesActionsTest-1070617 tempest-VolumesActionsTest-1070617-project] 10.222.0.32 "GET /compute/v2.1/servers/0af72798-5465-4a26-9734-daa2b0dc9af8" status: 404 len: 111 microversion: 2.1 time: 0.063832 Jul 13 02:34:35.549222 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 508/1006] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:34:35 2021] GET /compute/v2.1/servers/0af72798-5465-4a26-9734-daa2b0dc9af8 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 02:34:52.587909 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-118ff39b-1071-43d5-998e-8993a483a171 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:34:52.588500 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-118ff39b-1071-43d5-998e-8993a483a171 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d57716e0-3826-4e42-ad25-42cd46585692] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:34:52.594656 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-118ff39b-1071-43d5-998e-8993a483a171 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:52.595568 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-118ff39b-1071-43d5-998e-8993a483a171 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:52.596613 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-118ff39b-1071-43d5-998e-8993a483a171 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:52.597052 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-118ff39b-1071-43d5-998e-8993a483a171 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:52.600218 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:52.600218 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:34:52.664394 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-118ff39b-1071-43d5-998e-8993a483a171 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d57716e0-3826-4e42-ad25-42cd46585692] Going to try to terminate instance {{(pid=107262) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 13 02:34:52.666640 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3008: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:52.666640 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).\ Jul 13 02:34:52.679927 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:52.679927 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:34:52.737659 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/update_match.py:472: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:52.737659 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = query.session.execute(update_stmt) Jul 13 02:34:52.752447 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:530: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:52.752447 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = model_query(context, models.Service, read_deleted="no").\ Jul 13 02:34:52.786091 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-118ff39b-1071-43d5-998e-8993a483a171 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "DELETE /compute/v2.1/servers/d57716e0-3826-4e42-ad25-42cd46585692" status: 204 len: 0 microversion: 2.1 time: 0.201763 Jul 13 02:34:52.789806 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 499/1007] 10.222.0.32 () {58 vars in 1239 bytes} [Tue Jul 13 02:34:52 2021] DELETE /compute/v2.1/servers/d57716e0-3826-4e42-ad25-42cd46585692 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 13 02:34:52.794999 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-056cad10-c4b5-49dc-b719-4f5d18255ee2 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:34:52.795611 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-056cad10-c4b5-49dc-b719-4f5d18255ee2 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d57716e0-3826-4e42-ad25-42cd46585692] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:34:52.803302 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-056cad10-c4b5-49dc-b719-4f5d18255ee2 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:52.804074 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-056cad10-c4b5-49dc-b719-4f5d18255ee2 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:52.805102 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-056cad10-c4b5-49dc-b719-4f5d18255ee2 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:52.805761 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-056cad10-c4b5-49dc-b719-4f5d18255ee2 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:52.811079 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:52.811079 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:34:53.009141 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-056cad10-c4b5-49dc-b719-4f5d18255ee2 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:34:53.012800 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:53.012800 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:34:53.025240 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-056cad10-c4b5-49dc-b719-4f5d18255ee2 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/d57716e0-3826-4e42-ad25-42cd46585692" status: 200 len: 1576 microversion: 2.1 time: 0.233941 Jul 13 02:34:53.035196 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 509/1008] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:34:52 2021] GET /compute/v2.1/servers/d57716e0-3826-4e42-ad25-42cd46585692 => generated 1576 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:34:54.046162 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-fc70031d-97cf-448e-bc97-52ef1e922ad4 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:34:54.048273 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-fc70031d-97cf-448e-bc97-52ef1e922ad4 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d57716e0-3826-4e42-ad25-42cd46585692] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:34:54.056345 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-fc70031d-97cf-448e-bc97-52ef1e922ad4 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:54.056866 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-fc70031d-97cf-448e-bc97-52ef1e922ad4 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:54.057857 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-fc70031d-97cf-448e-bc97-52ef1e922ad4 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:54.058358 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-fc70031d-97cf-448e-bc97-52ef1e922ad4 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:54.061635 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:54.061635 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:34:54.283421 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-fc70031d-97cf-448e-bc97-52ef1e922ad4 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:34:54.286179 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:54.286179 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:34:54.293526 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-fc70031d-97cf-448e-bc97-52ef1e922ad4 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/d57716e0-3826-4e42-ad25-42cd46585692" status: 200 len: 1576 microversion: 2.1 time: 0.253945 Jul 13 02:34:54.294322 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 500/1009] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:34:54 2021] GET /compute/v2.1/servers/d57716e0-3826-4e42-ad25-42cd46585692 => generated 1576 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:34:55.312147 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-ac161f56-bd60-4d51-9f13-9d352b16b9bc tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:34:55.312766 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-ac161f56-bd60-4d51-9f13-9d352b16b9bc tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d57716e0-3826-4e42-ad25-42cd46585692] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:34:55.318767 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ac161f56-bd60-4d51-9f13-9d352b16b9bc tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:55.319221 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ac161f56-bd60-4d51-9f13-9d352b16b9bc tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:55.320002 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ac161f56-bd60-4d51-9f13-9d352b16b9bc tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:55.320439 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-ac161f56-bd60-4d51-9f13-9d352b16b9bc tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:55.323420 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:55.323420 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:34:55.457698 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-ac161f56-bd60-4d51-9f13-9d352b16b9bc tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:34:55.460440 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:55.460440 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:34:55.467492 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-ac161f56-bd60-4d51-9f13-9d352b16b9bc tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/d57716e0-3826-4e42-ad25-42cd46585692" status: 200 len: 1509 microversion: 2.1 time: 0.159028 Jul 13 02:34:55.468064 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 510/1010] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:34:55 2021] GET /compute/v2.1/servers/d57716e0-3826-4e42-ad25-42cd46585692 => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:34:55.572268 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-4bc34118-abb8-4c86-8404-10343feb05dc req-16cf4ac0-89aa-4e9e-bdc6-b08fb164d3ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d57716e0-3826-4e42-ad25-42cd46585692", "name": "network-vif-deleted", "tag": "a5ebc0a6-1594-4ae0-8308-07615056f845"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:34:55.574507 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:34:55.574507 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:34:55.581353 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-4bc34118-abb8-4c86-8404-10343feb05dc req-16cf4ac0-89aa-4e9e-bdc6-b08fb164d3ca service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:55.581788 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-4bc34118-abb8-4c86-8404-10343feb05dc req-16cf4ac0-89aa-4e9e-bdc6-b08fb164d3ca service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:55.592836 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-4bc34118-abb8-4c86-8404-10343feb05dc req-16cf4ac0-89aa-4e9e-bdc6-b08fb164d3ca service nova] Creating event network-vif-deleted:a5ebc0a6-1594-4ae0-8308-07615056f845 for instance d57716e0-3826-4e42-ad25-42cd46585692 on hv-cinder-78102 Jul 13 02:34:55.598658 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-4bc34118-abb8-4c86-8404-10343feb05dc req-16cf4ac0-89aa-4e9e-bdc6-b08fb164d3ca service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030122 Jul 13 02:34:55.599865 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 501/1011] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:34:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:34:56.484438 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-e5c8beff-45c9-4e29-bfd2-0278439cdbc0 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:34:56.485664 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-e5c8beff-45c9-4e29-bfd2-0278439cdbc0 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d57716e0-3826-4e42-ad25-42cd46585692] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:34:56.494722 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e5c8beff-45c9-4e29-bfd2-0278439cdbc0 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:56.495416 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e5c8beff-45c9-4e29-bfd2-0278439cdbc0 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:56.496363 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e5c8beff-45c9-4e29-bfd2-0278439cdbc0 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:56.496859 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e5c8beff-45c9-4e29-bfd2-0278439cdbc0 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:56.499986 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:56.499986 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:34:56.552065 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.wsgi [None req-e5c8beff-45c9-4e29-bfd2-0278439cdbc0 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] HTTP exception thrown: Instance d57716e0-3826-4e42-ad25-42cd46585692 could not be found. Jul 13 02:34:56.552853 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-e5c8beff-45c9-4e29-bfd2-0278439cdbc0 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Returning 404 to user: Instance d57716e0-3826-4e42-ad25-42cd46585692 could not be found. {{(pid=107263) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:34:56.554082 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-e5c8beff-45c9-4e29-bfd2-0278439cdbc0 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/d57716e0-3826-4e42-ad25-42cd46585692" status: 404 len: 111 microversion: 2.1 time: 0.073122 Jul 13 02:34:56.554813 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 511/1012] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:34:56 2021] GET /compute/v2.1/servers/d57716e0-3826-4e42-ad25-42cd46585692 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 02:34:56.665930 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-658d5540-247d-40e4-bcfc-7f529620a87b tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-92636862", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-96975266", "security_groups": [{"name": "tempest-secgroup-smoke-327206247"}], "block_device_mapping_v2": [{"uuid": "4e0aef80-ad62-46e4-8d00-2820ceb901c8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "afd43932-4582-4e2a-8e2b-804f55bae1f7"}]}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:34:56.772006 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.network.neutron [None req-658d5540-247d-40e4-bcfc-7f529620a87b tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] validate_networks() for [('afd43932-4582-4e2a-8e2b-804f55bae1f7', None, None, None)] {{(pid=107262) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Jul 13 02:34:57.240534 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-658d5540-247d-40e4-bcfc-7f529620a87b tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Flavor limits 0:0:0 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 02:34:57.240961 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-658d5540-247d-40e4-bcfc-7f529620a87b tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Image limits 0:0:0 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 02:34:57.241434 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-658d5540-247d-40e4-bcfc-7f529620a87b tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Flavor pref 0:0:0 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 02:34:57.241867 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-658d5540-247d-40e4-bcfc-7f529620a87b tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Image pref 0:0:0 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 02:34:57.242316 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-658d5540-247d-40e4-bcfc-7f529620a87b tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 02:34:57.248076 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2690: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:57.248076 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: user_quotas = model_query(context, models.ProjectUserQuota, Jul 13 02:34:57.252357 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-658d5540-247d-40e4-bcfc-7f529620a87b tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:57.252797 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-658d5540-247d-40e4-bcfc-7f529620a87b tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:57.253599 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-658d5540-247d-40e4-bcfc-7f529620a87b tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:57.254044 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-658d5540-247d-40e4-bcfc-7f529620a87b tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:57.258625 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/objects/instance.py:1537: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:57.258625 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: project_result = project_query.first() Jul 13 02:34:57.270920 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2708: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:57.270920 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: rows = model_query(context, models.Quota, read_deleted="no").\ Jul 13 02:34:57.274515 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.quota [None req-658d5540-247d-40e4-bcfc-7f529620a87b tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Getting quotas for project 345d0f5c3c2842e0940d216397b5cd51. Resources: {'ram', 'cores', 'instances'} {{(pid=107262) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 13 02:34:57.278369 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.quota [None req-658d5540-247d-40e4-bcfc-7f529620a87b tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Getting quotas for user 2e23950a4bea4e70a2a8be2c2dd9743e and project 345d0f5c3c2842e0940d216397b5cd51. Resources: {'ram', 'cores', 'instances'} {{(pid=107262) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 13 02:34:57.339284 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-658d5540-247d-40e4-bcfc-7f529620a87b tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Going to run 1 instances... {{(pid=107262) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 13 02:34:57.341472 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-658d5540-247d-40e4-bcfc-7f529620a87b tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: 7d96b396-3586-4250-aa00-46948258c2bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4e0aef80-ad62-46e4-8d00-2820ceb901c8',volume_size=None,volume_type=None)] {{(pid=107262) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 13 02:34:57.459421 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: ERROR oslo.messaging._drivers.impl_rabbit [None req-658d5540-247d-40e4-bcfc-7f529620a87b tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [e93fa69c-e1b2-4563-a6af-16a0bafce573] AMQP server on 10.222.0.32:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 13 02:34:58.476295 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO oslo.messaging._drivers.impl_rabbit [None req-658d5540-247d-40e4-bcfc-7f529620a87b tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [e93fa69c-e1b2-4563-a6af-16a0bafce573] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 43580. Jul 13 02:34:58.489348 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-658d5540-247d-40e4-bcfc-7f529620a87b tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.827342 Jul 13 02:34:58.489997 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 502/1013] 10.222.0.32 () {60 vars in 1147 bytes} [Tue Jul 13 02:34:56 2021] POST /compute/v2.1/servers => generated 405 bytes in 1829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 02:34:58.499757 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-f319c481-1189-4e54-82fc-0666b3ac3e11 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:34:58.500406 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-f319c481-1189-4e54-82fc-0666b3ac3e11 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: 7d96b396-3586-4250-aa00-46948258c2bd] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:34:58.559757 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-f319c481-1189-4e54-82fc-0666b3ac3e11 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:34:58.562624 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:58.562624 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:34:58.571368 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-f319c481-1189-4e54-82fc-0666b3ac3e11 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/7d96b396-3586-4250-aa00-46948258c2bd" status: 200 len: 1091 microversion: 2.1 time: 0.075148 Jul 13 02:34:58.572266 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 512/1014] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:34:58 2021] GET /compute/v2.1/servers/7d96b396-3586-4250-aa00-46948258c2bd => generated 1091 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:34:59.589117 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-ca987283-a957-46dd-8e17-dab0dda6c4e3 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:34:59.589729 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-ca987283-a957-46dd-8e17-dab0dda6c4e3 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: 7d96b396-3586-4250-aa00-46948258c2bd] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:34:59.597985 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ca987283-a957-46dd-8e17-dab0dda6c4e3 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:59.598668 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ca987283-a957-46dd-8e17-dab0dda6c4e3 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:59.600377 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ca987283-a957-46dd-8e17-dab0dda6c4e3 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:34:59.601606 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ca987283-a957-46dd-8e17-dab0dda6c4e3 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:34:59.606837 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:59.606837 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:34:59.763219 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-ca987283-a957-46dd-8e17-dab0dda6c4e3 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:34:59.766055 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:34:59.766055 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:34:59.773388 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-ca987283-a957-46dd-8e17-dab0dda6c4e3 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/7d96b396-3586-4250-aa00-46948258c2bd" status: 200 len: 1207 microversion: 2.1 time: 0.187867 Jul 13 02:34:59.774092 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 503/1015] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:34:59 2021] GET /compute/v2.1/servers/7d96b396-3586-4250-aa00-46948258c2bd => generated 1207 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:35:00.791613 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-02adcfc8-2143-4225-954a-9cf987679dff tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:35:00.792494 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-02adcfc8-2143-4225-954a-9cf987679dff tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: 7d96b396-3586-4250-aa00-46948258c2bd] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:35:00.799306 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-02adcfc8-2143-4225-954a-9cf987679dff tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:35:00.800138 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-02adcfc8-2143-4225-954a-9cf987679dff tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:35:00.801980 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-02adcfc8-2143-4225-954a-9cf987679dff tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:35:00.802493 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-02adcfc8-2143-4225-954a-9cf987679dff tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:35:00.805900 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:35:00.805900 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:35:01.084711 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-666aa329-cf78-4349-83c0-b108f7765410 req-0bb1b967-4a08-42a1-8bef-e977ea9e6b3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d96b396-3586-4250-aa00-46948258c2bd", "tag": "740bf26b-031b-45ff-bd93-aaac93efe690"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:35:01.088006 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:35:01.088006 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:35:01.097611 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-666aa329-cf78-4349-83c0-b108f7765410 req-0bb1b967-4a08-42a1-8bef-e977ea9e6b3b service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:35:01.098595 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-666aa329-cf78-4349-83c0-b108f7765410 req-0bb1b967-4a08-42a1-8bef-e977ea9e6b3b service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:35:01.112257 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-666aa329-cf78-4349-83c0-b108f7765410 req-0bb1b967-4a08-42a1-8bef-e977ea9e6b3b service nova] Creating event network-changed:740bf26b-031b-45ff-bd93-aaac93efe690 for instance 7d96b396-3586-4250-aa00-46948258c2bd on hv-cinder-78102 Jul 13 02:35:01.117374 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-666aa329-cf78-4349-83c0-b108f7765410 req-0bb1b967-4a08-42a1-8bef-e977ea9e6b3b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037200 Jul 13 02:35:01.119401 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 504/1016] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:35:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 02:35:01.121115 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-02adcfc8-2143-4225-954a-9cf987679dff tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:35:01.123957 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:35:01.123957 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:35:01.132347 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-02adcfc8-2143-4225-954a-9cf987679dff tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/7d96b396-3586-4250-aa00-46948258c2bd" status: 200 len: 1262 microversion: 2.1 time: 0.344704 Jul 13 02:35:01.133219 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 513/1017] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:35:00 2021] GET /compute/v2.1/servers/7d96b396-3586-4250-aa00-46948258c2bd => generated 1262 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:35:02.151203 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-186b416f-804f-447f-b2b9-e156a53961b9 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:35:02.151904 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-186b416f-804f-447f-b2b9-e156a53961b9 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: 7d96b396-3586-4250-aa00-46948258c2bd] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:35:02.158172 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-186b416f-804f-447f-b2b9-e156a53961b9 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:35:02.158617 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-186b416f-804f-447f-b2b9-e156a53961b9 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:35:02.159381 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-186b416f-804f-447f-b2b9-e156a53961b9 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:35:02.159812 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-186b416f-804f-447f-b2b9-e156a53961b9 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:35:02.162673 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:35:02.162673 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:35:02.338410 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-186b416f-804f-447f-b2b9-e156a53961b9 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:35:02.341007 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:35:02.341007 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:35:02.347872 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-186b416f-804f-447f-b2b9-e156a53961b9 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/7d96b396-3586-4250-aa00-46948258c2bd" status: 200 len: 1262 microversion: 2.1 time: 0.200693 Jul 13 02:35:02.348433 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 505/1018] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:35:02 2021] GET /compute/v2.1/servers/7d96b396-3586-4250-aa00-46948258c2bd => generated 1262 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:35:03.364462 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-9913d015-8e3b-4514-b0b5-363d4f271f56 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:35:03.365074 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-9913d015-8e3b-4514-b0b5-363d4f271f56 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: 7d96b396-3586-4250-aa00-46948258c2bd] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:35:03.370976 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-9913d015-8e3b-4514-b0b5-363d4f271f56 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:35:03.371425 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-9913d015-8e3b-4514-b0b5-363d4f271f56 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:35:03.372195 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-9913d015-8e3b-4514-b0b5-363d4f271f56 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:35:03.372628 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-9913d015-8e3b-4514-b0b5-363d4f271f56 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:35:03.375450 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:35:03.375450 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:35:03.549347 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-9913d015-8e3b-4514-b0b5-363d4f271f56 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:35:03.551974 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:35:03.551974 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:35:03.558916 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-9913d015-8e3b-4514-b0b5-363d4f271f56 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/7d96b396-3586-4250-aa00-46948258c2bd" status: 200 len: 1262 microversion: 2.1 time: 0.198335 Jul 13 02:35:03.559472 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 514/1019] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:35:03 2021] GET /compute/v2.1/servers/7d96b396-3586-4250-aa00-46948258c2bd => generated 1262 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:35:04.576222 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-32a486c3-f8e5-4962-8e03-328f2548a99e tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:35:04.576832 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-32a486c3-f8e5-4962-8e03-328f2548a99e tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: 7d96b396-3586-4250-aa00-46948258c2bd] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:35:04.583047 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-32a486c3-f8e5-4962-8e03-328f2548a99e tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:35:04.583488 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-32a486c3-f8e5-4962-8e03-328f2548a99e tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:35:04.584239 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-32a486c3-f8e5-4962-8e03-328f2548a99e tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:35:04.584665 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-32a486c3-f8e5-4962-8e03-328f2548a99e tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:35:04.587683 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:35:04.587683 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:35:04.759870 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-32a486c3-f8e5-4962-8e03-328f2548a99e tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:35:04.762673 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:35:04.762673 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:35:04.770019 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-32a486c3-f8e5-4962-8e03-328f2548a99e tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/7d96b396-3586-4250-aa00-46948258c2bd" status: 200 len: 1262 microversion: 2.1 time: 0.197594 Jul 13 02:35:04.770604 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 506/1020] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:35:04 2021] GET /compute/v2.1/servers/7d96b396-3586-4250-aa00-46948258c2bd => generated 1262 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:35:05.787254 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-9be496b5-adc8-43c1-9fcd-c6182775fa9a tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:35:05.787880 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-9be496b5-adc8-43c1-9fcd-c6182775fa9a tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: 7d96b396-3586-4250-aa00-46948258c2bd] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:35:05.793568 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-9be496b5-adc8-43c1-9fcd-c6182775fa9a tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:35:05.794015 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-9be496b5-adc8-43c1-9fcd-c6182775fa9a tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:35:05.794808 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-9be496b5-adc8-43c1-9fcd-c6182775fa9a tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:35:05.795246 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-9be496b5-adc8-43c1-9fcd-c6182775fa9a tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:35:05.798799 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:35:05.798799 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:35:05.970391 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-9be496b5-adc8-43c1-9fcd-c6182775fa9a tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:35:05.973231 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:35:05.973231 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:35:05.980204 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-9be496b5-adc8-43c1-9fcd-c6182775fa9a tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/7d96b396-3586-4250-aa00-46948258c2bd" status: 200 len: 1262 microversion: 2.1 time: 0.196785 Jul 13 02:35:05.980773 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 515/1021] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:35:05 2021] GET /compute/v2.1/servers/7d96b396-3586-4250-aa00-46948258c2bd => generated 1262 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:35:06.997783 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-07b735f1-256b-4d43-bf67-81c0ac9b30c8 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:35:06.998410 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-07b735f1-256b-4d43-bf67-81c0ac9b30c8 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: 7d96b396-3586-4250-aa00-46948258c2bd] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:35:07.005039 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-07b735f1-256b-4d43-bf67-81c0ac9b30c8 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:35:07.005486 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-07b735f1-256b-4d43-bf67-81c0ac9b30c8 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:35:07.006324 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-07b735f1-256b-4d43-bf67-81c0ac9b30c8 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:35:07.006768 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-07b735f1-256b-4d43-bf67-81c0ac9b30c8 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:35:07.009653 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:35:07.009653 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:35:07.187468 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-07b735f1-256b-4d43-bf67-81c0ac9b30c8 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:35:07.190666 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:35:07.190666 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:35:07.197353 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-07b735f1-256b-4d43-bf67-81c0ac9b30c8 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/7d96b396-3586-4250-aa00-46948258c2bd" status: 200 len: 1262 microversion: 2.1 time: 0.203540 Jul 13 02:35:07.197905 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 507/1022] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:35:06 2021] GET /compute/v2.1/servers/7d96b396-3586-4250-aa00-46948258c2bd => generated 1262 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:35:08.214130 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-6014cc94-4c13-4815-bf31-0d74e9f9315a tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:35:08.215307 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-6014cc94-4c13-4815-bf31-0d74e9f9315a tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: 7d96b396-3586-4250-aa00-46948258c2bd] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:35:08.221397 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6014cc94-4c13-4815-bf31-0d74e9f9315a tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:35:08.221849 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6014cc94-4c13-4815-bf31-0d74e9f9315a tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:35:08.222711 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6014cc94-4c13-4815-bf31-0d74e9f9315a tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:35:08.223145 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-6014cc94-4c13-4815-bf31-0d74e9f9315a tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:35:08.226094 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:35:08.226094 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:35:08.400860 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-6014cc94-4c13-4815-bf31-0d74e9f9315a tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:35:08.403467 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:35:08.403467 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:35:08.410397 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-6014cc94-4c13-4815-bf31-0d74e9f9315a tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/7d96b396-3586-4250-aa00-46948258c2bd" status: 200 len: 1262 microversion: 2.1 time: 0.200313 Jul 13 02:35:08.410964 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 516/1023] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:35:08 2021] GET /compute/v2.1/servers/7d96b396-3586-4250-aa00-46948258c2bd => generated 1262 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:35:09.426838 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-c329f1cd-2378-437c-87d1-be3b74708c85 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:35:09.427448 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-c329f1cd-2378-437c-87d1-be3b74708c85 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: 7d96b396-3586-4250-aa00-46948258c2bd] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:35:09.433558 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c329f1cd-2378-437c-87d1-be3b74708c85 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:35:09.434019 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c329f1cd-2378-437c-87d1-be3b74708c85 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:35:09.434823 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c329f1cd-2378-437c-87d1-be3b74708c85 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:35:09.435266 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c329f1cd-2378-437c-87d1-be3b74708c85 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:35:09.438845 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:35:09.438845 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:35:09.626953 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-c329f1cd-2378-437c-87d1-be3b74708c85 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:35:09.629559 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:35:09.629559 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:35:09.636974 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-c329f1cd-2378-437c-87d1-be3b74708c85 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/7d96b396-3586-4250-aa00-46948258c2bd" status: 200 len: 1262 microversion: 2.1 time: 0.213676 Jul 13 02:35:09.637910 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 508/1024] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:35:09 2021] GET /compute/v2.1/servers/7d96b396-3586-4250-aa00-46948258c2bd => generated 1262 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:35:10.653890 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-45da99e6-1533-46b2-95b1-52119c6b42bc tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:35:10.654478 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-45da99e6-1533-46b2-95b1-52119c6b42bc tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: 7d96b396-3586-4250-aa00-46948258c2bd] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:35:10.660925 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-45da99e6-1533-46b2-95b1-52119c6b42bc tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:35:10.661378 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-45da99e6-1533-46b2-95b1-52119c6b42bc tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:35:10.662179 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-45da99e6-1533-46b2-95b1-52119c6b42bc tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:35:10.662617 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-45da99e6-1533-46b2-95b1-52119c6b42bc tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:35:10.665419 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:35:10.665419 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:35:10.835156 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-45da99e6-1533-46b2-95b1-52119c6b42bc tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:35:10.837745 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:35:10.837745 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:35:10.845295 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-45da99e6-1533-46b2-95b1-52119c6b42bc tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/7d96b396-3586-4250-aa00-46948258c2bd" status: 200 len: 1262 microversion: 2.1 time: 0.194584 Jul 13 02:35:10.845879 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 517/1025] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:35:10 2021] GET /compute/v2.1/servers/7d96b396-3586-4250-aa00-46948258c2bd => generated 1262 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:35:11.499902 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-592d7755-9b37-4c4f-a0a1-6866065f270b req-36fea7e2-5ae1-44ff-aac6-2402f2cda7da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d96b396-3586-4250-aa00-46948258c2bd", "name": "network-vif-plugged", "status": "completed", "tag": "740bf26b-031b-45ff-bd93-aaac93efe690"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:35:11.502017 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:35:11.502017 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:35:11.509083 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-592d7755-9b37-4c4f-a0a1-6866065f270b req-36fea7e2-5ae1-44ff-aac6-2402f2cda7da service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:35:11.509525 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-592d7755-9b37-4c4f-a0a1-6866065f270b req-36fea7e2-5ae1-44ff-aac6-2402f2cda7da service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:35:11.521038 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-592d7755-9b37-4c4f-a0a1-6866065f270b req-36fea7e2-5ae1-44ff-aac6-2402f2cda7da service nova] Creating event network-vif-plugged:740bf26b-031b-45ff-bd93-aaac93efe690 for instance 7d96b396-3586-4250-aa00-46948258c2bd on hv-cinder-78102 Jul 13 02:35:11.526011 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-592d7755-9b37-4c4f-a0a1-6866065f270b req-36fea7e2-5ae1-44ff-aac6-2402f2cda7da service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029795 Jul 13 02:35:11.526610 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 509/1026] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:35:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:35:11.862482 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-bb87c7a5-f56c-4dc2-9cb6-3733f0f840c8 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:35:11.863096 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-bb87c7a5-f56c-4dc2-9cb6-3733f0f840c8 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: 7d96b396-3586-4250-aa00-46948258c2bd] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:35:11.870396 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-bb87c7a5-f56c-4dc2-9cb6-3733f0f840c8 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:35:11.871181 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-bb87c7a5-f56c-4dc2-9cb6-3733f0f840c8 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:35:11.872176 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-bb87c7a5-f56c-4dc2-9cb6-3733f0f840c8 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:35:11.872608 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-bb87c7a5-f56c-4dc2-9cb6-3733f0f840c8 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:35:11.875954 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:35:11.875954 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:35:12.051228 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-bb87c7a5-f56c-4dc2-9cb6-3733f0f840c8 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:35:12.053797 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:35:12.053797 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:35:12.060569 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-bb87c7a5-f56c-4dc2-9cb6-3733f0f840c8 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/7d96b396-3586-4250-aa00-46948258c2bd" status: 200 len: 1262 microversion: 2.1 time: 0.202472 Jul 13 02:35:12.061233 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 518/1027] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:35:11 2021] GET /compute/v2.1/servers/7d96b396-3586-4250-aa00-46948258c2bd => generated 1262 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:35:13.077800 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-8adcf799-e5ae-4794-85c3-ed31f5c64312 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:35:13.078781 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-8adcf799-e5ae-4794-85c3-ed31f5c64312 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: 7d96b396-3586-4250-aa00-46948258c2bd] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:35:13.085928 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8adcf799-e5ae-4794-85c3-ed31f5c64312 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:35:13.086410 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8adcf799-e5ae-4794-85c3-ed31f5c64312 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:35:13.087194 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8adcf799-e5ae-4794-85c3-ed31f5c64312 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:35:13.087633 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8adcf799-e5ae-4794-85c3-ed31f5c64312 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:35:13.090541 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:35:13.090541 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:35:13.260997 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-8adcf799-e5ae-4794-85c3-ed31f5c64312 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:35:13.263929 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:35:13.263929 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:35:13.270731 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-8adcf799-e5ae-4794-85c3-ed31f5c64312 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/7d96b396-3586-4250-aa00-46948258c2bd" status: 200 len: 1449 microversion: 2.1 time: 0.197744 Jul 13 02:35:13.271291 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 510/1028] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:35:13 2021] GET /compute/v2.1/servers/7d96b396-3586-4250-aa00-46948258c2bd => generated 1449 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:35:13.286959 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-e6f95ad1-eb86-4f40-af2c-e1f73a98d01a tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:35:13.287726 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-e6f95ad1-eb86-4f40-af2c-e1f73a98d01a tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: 7d96b396-3586-4250-aa00-46948258c2bd] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:35:13.293302 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e6f95ad1-eb86-4f40-af2c-e1f73a98d01a tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:35:13.293744 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e6f95ad1-eb86-4f40-af2c-e1f73a98d01a tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:35:13.294540 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e6f95ad1-eb86-4f40-af2c-e1f73a98d01a tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:35:13.294968 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-e6f95ad1-eb86-4f40-af2c-e1f73a98d01a tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:35:13.297770 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:35:13.297770 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:35:13.469325 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-e6f95ad1-eb86-4f40-af2c-e1f73a98d01a tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:35:13.472554 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:35:13.472554 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:35:13.479433 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-e6f95ad1-eb86-4f40-af2c-e1f73a98d01a tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/7d96b396-3586-4250-aa00-46948258c2bd" status: 200 len: 1449 microversion: 2.1 time: 0.196902 Jul 13 02:35:13.480001 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 519/1029] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:35:13 2021] GET /compute/v2.1/servers/7d96b396-3586-4250-aa00-46948258c2bd => generated 1449 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:35:15.343896 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-21a2263e-8d08-4fd5-9d93-63ce840a535e req-51f812ab-2bee-4294-b5f2-58b3b9685d3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d96b396-3586-4250-aa00-46948258c2bd", "tag": "740bf26b-031b-45ff-bd93-aaac93efe690"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:35:15.345555 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:35:15.345555 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:35:15.352688 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-21a2263e-8d08-4fd5-9d93-63ce840a535e req-51f812ab-2bee-4294-b5f2-58b3b9685d3c service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:35:15.353130 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-21a2263e-8d08-4fd5-9d93-63ce840a535e req-51f812ab-2bee-4294-b5f2-58b3b9685d3c service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:35:15.366343 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-21a2263e-8d08-4fd5-9d93-63ce840a535e req-51f812ab-2bee-4294-b5f2-58b3b9685d3c service nova] Creating event network-changed:740bf26b-031b-45ff-bd93-aaac93efe690 for instance 7d96b396-3586-4250-aa00-46948258c2bd on hv-cinder-78102 Jul 13 02:35:15.371214 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-21a2263e-8d08-4fd5-9d93-63ce840a535e req-51f812ab-2bee-4294-b5f2-58b3b9685d3c service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037414 Jul 13 02:35:15.371818 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 511/1030] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:35:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 13 02:36:15.981286 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 13 02:36:15.981880 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: Tue Jul 13 02:36:15 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 13 02:36:36.048954 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7e6ef907-eb20-457e-bb20-384f86ee2428] AMQP server on 10.222.0.32:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 13 02:36:36.202202 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-6ae82c49-7305-416c-b949-26a178287f99 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Action: 'create', calling method: .version_select at 0x7f4312c191f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1258503872"}} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:36:36.210358 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2656: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:36:36.210358 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return model_query(context, models.KeyPair, read_deleted="no").\ Jul 13 02:36:36.221873 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2708: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:36:36.221873 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: rows = model_query(context, models.Quota, read_deleted="no").\ Jul 13 02:36:36.225454 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.quota [None req-6ae82c49-7305-416c-b949-26a178287f99 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Getting quotas for project 5c8b5616059f43f097126facb22ac41a. Resources: {'key_pairs'} {{(pid=107263) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 13 02:36:36.230298 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.quota [None req-6ae82c49-7305-416c-b949-26a178287f99 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Getting quotas for user 70f53f7247a54158825bddc30b96b4f8 and project 5c8b5616059f43f097126facb22ac41a. Resources: {'key_pairs'} {{(pid=107263) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 13 02:36:36.235394 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2690: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:36:36.235394 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: user_quotas = model_query(context, models.ProjectUserQuota, Jul 13 02:36:36.453608 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2621: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:36:36.453608 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = model_query(context, models.KeyPair).\ Jul 13 02:36:36.482917 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.quota [None req-6ae82c49-7305-416c-b949-26a178287f99 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Getting quotas for project 5c8b5616059f43f097126facb22ac41a. Resources: {'key_pairs'} {{(pid=107263) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 13 02:36:36.487110 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.quota [None req-6ae82c49-7305-416c-b949-26a178287f99 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Getting quotas for user 70f53f7247a54158825bddc30b96b4f8 and project 5c8b5616059f43f097126facb22ac41a. Resources: {'key_pairs'} {{(pid=107263) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 13 02:36:36.512853 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-6ae82c49-7305-416c-b949-26a178287f99 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.464738 Jul 13 02:36:36.514053 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 520/1031] 10.222.0.32 () {60 vars in 1158 bytes} [Tue Jul 13 02:36:36 2021] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:36:53.885178 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fde8e23d-5763-437f-90c7-2cd0eebfc6a8] AMQP server on 10.222.0.32:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 13 02:36:53.889376 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-1633aecb-2bcf-4d73-9c42-dd1a315f12da tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-133605194", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1258503872", "security_groups": [{"name": "tempest-secgroup-smoke-1342042681"}], "networks": [{"uuid": "4f1601d3-b85d-4846-b61f-1a90d074cd54"}], "block_device_mapping_v2": [{"uuid": "a21f9fe5-02e7-4d88-9900-6606090097c5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:36:53.990554 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.network.neutron [None req-1633aecb-2bcf-4d73-9c42-dd1a315f12da tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] validate_networks() for [('4f1601d3-b85d-4846-b61f-1a90d074cd54', None, None, None)] {{(pid=107262) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Jul 13 02:36:54.353334 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-1633aecb-2bcf-4d73-9c42-dd1a315f12da tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Flavor limits 0:0:0 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 02:36:54.353762 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-1633aecb-2bcf-4d73-9c42-dd1a315f12da tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Image limits 0:0:0 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 02:36:54.354270 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-1633aecb-2bcf-4d73-9c42-dd1a315f12da tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Flavor pref 0:0:0 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 02:36:54.354679 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-1633aecb-2bcf-4d73-9c42-dd1a315f12da tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Image pref 0:0:0 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 02:36:54.355087 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-1633aecb-2bcf-4d73-9c42-dd1a315f12da tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 02:36:54.360949 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2690: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:36:54.360949 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: user_quotas = model_query(context, models.ProjectUserQuota, Jul 13 02:36:54.364630 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1633aecb-2bcf-4d73-9c42-dd1a315f12da tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:36:54.365083 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1633aecb-2bcf-4d73-9c42-dd1a315f12da tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:36:54.365885 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1633aecb-2bcf-4d73-9c42-dd1a315f12da tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:36:54.366361 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1633aecb-2bcf-4d73-9c42-dd1a315f12da tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:36:54.371751 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/objects/instance.py:1537: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:36:54.371751 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: project_result = project_query.first() Jul 13 02:36:54.383920 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2708: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:36:54.383920 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: rows = model_query(context, models.Quota, read_deleted="no").\ Jul 13 02:36:54.387723 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.quota [None req-1633aecb-2bcf-4d73-9c42-dd1a315f12da tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Getting quotas for project 5c8b5616059f43f097126facb22ac41a. Resources: {'ram', 'cores', 'instances'} {{(pid=107262) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 13 02:36:54.391642 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.quota [None req-1633aecb-2bcf-4d73-9c42-dd1a315f12da tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Getting quotas for user 70f53f7247a54158825bddc30b96b4f8 and project 5c8b5616059f43f097126facb22ac41a. Resources: {'ram', 'cores', 'instances'} {{(pid=107262) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 13 02:36:54.452783 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-1633aecb-2bcf-4d73-9c42-dd1a315f12da tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Going to run 1 instances... {{(pid=107262) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 13 02:36:54.455088 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-1633aecb-2bcf-4d73-9c42-dd1a315f12da tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a21f9fe5-02e7-4d88-9900-6606090097c5',volume_size=None,volume_type=None)] {{(pid=107262) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 13 02:36:54.575468 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-1633aecb-2bcf-4d73-9c42-dd1a315f12da tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.693222 Jul 13 02:36:54.576099 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 512/1032] 10.222.0.32 () {60 vars in 1147 bytes} [Tue Jul 13 02:36:53 2021] POST /compute/v2.1/servers => generated 406 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 13 02:36:54.597563 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-4b909751-33df-4844-b42f-38f99e311b77 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:36:54.598221 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-4b909751-33df-4844-b42f-38f99e311b77 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:36:54.621381 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO oslo.messaging._drivers.impl_rabbit [-] [7e6ef907-eb20-457e-bb20-384f86ee2428] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 44420. Jul 13 02:36:54.653784 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-4b909751-33df-4844-b42f-38f99e311b77 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f53f7247a54158825bddc30b96b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8b5616059f43f097126facb22ac41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:36:54.656426 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:36:54.656426 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:36:54.663417 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-4b909751-33df-4844-b42f-38f99e311b77 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c" status: 200 len: 1088 microversion: 2.1 time: 0.080672 Jul 13 02:36:54.663981 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 521/1033] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:36:54 2021] GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c => generated 1088 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:36:55.692001 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-48203e9f-91e9-4324-8d31-02820ac0e0ca tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:36:55.692603 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-48203e9f-91e9-4324-8d31-02820ac0e0ca tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:36:55.700475 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-48203e9f-91e9-4324-8d31-02820ac0e0ca tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:36:55.700921 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-48203e9f-91e9-4324-8d31-02820ac0e0ca tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:36:55.701700 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-48203e9f-91e9-4324-8d31-02820ac0e0ca tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:36:55.702164 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-48203e9f-91e9-4324-8d31-02820ac0e0ca tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:36:55.706323 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:36:55.706323 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:36:55.733746 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO oslo.messaging._drivers.impl_rabbit [-] [fde8e23d-5763-437f-90c7-2cd0eebfc6a8] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 44432. Jul 13 02:36:55.956448 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-48203e9f-91e9-4324-8d31-02820ac0e0ca tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f53f7247a54158825bddc30b96b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8b5616059f43f097126facb22ac41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:36:55.959626 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:36:55.959626 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:36:55.967515 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-48203e9f-91e9-4324-8d31-02820ac0e0ca tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c" status: 200 len: 1204 microversion: 2.1 time: 0.290594 Jul 13 02:36:55.968177 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 513/1034] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:36:55 2021] GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c => generated 1204 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:36:56.984367 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [None req-818ca264-8434-4742-9eda-9d517db298c5 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Calling method '>' {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:36:56.984975 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.compute.api [None req-818ca264-8434-4742-9eda-9d517db298c5 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107263) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:36:56.990892 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-818ca264-8434-4742-9eda-9d517db298c5 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:36:56.991338 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-818ca264-8434-4742-9eda-9d517db298c5 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:36:56.992092 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-818ca264-8434-4742-9eda-9d517db298c5 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:36:56.992522 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [None req-818ca264-8434-4742-9eda-9d517db298c5 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:36:56.995900 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:36:56.995900 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:36:57.216811 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.policy [None req-818ca264-8434-4742-9eda-9d517db298c5 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f53f7247a54158825bddc30b96b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8b5616059f43f097126facb22ac41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107263) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:36:57.219400 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:36:57.219400 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: return _block_device_mapping_get_query(context).filter( Jul 13 02:36:57.226160 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.requestlog [None req-818ca264-8434-4742-9eda-9d517db298c5 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c" status: 200 len: 1272 microversion: 2.1 time: 0.245408 Jul 13 02:36:57.226720 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: [pid: 107263|app: 0|req: 522/1035] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:36:56 2021] GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c => generated 1272 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:36:58.242623 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-a21c00f4-66e2-4934-b74b-5d02cf5011f0 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:36:58.243309 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-a21c00f4-66e2-4934-b74b-5d02cf5011f0 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:36:58.249098 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a21c00f4-66e2-4934-b74b-5d02cf5011f0 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:36:58.249544 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a21c00f4-66e2-4934-b74b-5d02cf5011f0 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:36:58.250357 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a21c00f4-66e2-4934-b74b-5d02cf5011f0 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:36:58.250795 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a21c00f4-66e2-4934-b74b-5d02cf5011f0 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:36:58.253610 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:36:58.253610 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:36:58.424096 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-a21c00f4-66e2-4934-b74b-5d02cf5011f0 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f53f7247a54158825bddc30b96b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8b5616059f43f097126facb22ac41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:36:58.426620 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:36:58.426620 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:36:58.434112 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-a21c00f4-66e2-4934-b74b-5d02cf5011f0 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c" status: 200 len: 1272 microversion: 2.1 time: 0.195226 Jul 13 02:36:58.434674 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 514/1036] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:36:58 2021] GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c => generated 1272 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:36:59.370080 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG nova.api.openstack.wsgi [req-4cc7b76c-fe86-4485-9f8d-f94cf3361e1d req-4973f2eb-652f-4249-a1f5-95a4832f8539 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6d9fd73-2a8e-4766-a108-2024b292795c", "tag": "dcb6c645-5585-4723-9633-6f29ebaddeb8"}]} {{(pid=107263) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:36:59.371563 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:36:59.371563 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: warnings.warn(msg) Jul 13 02:36:59.384041 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-4cc7b76c-fe86-4485-9f8d-f94cf3361e1d req-4973f2eb-652f-4249-a1f5-95a4832f8539 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:36:59.385356 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: DEBUG oslo_concurrency.lockutils [req-4cc7b76c-fe86-4485-9f8d-f94cf3361e1d req-4973f2eb-652f-4249-a1f5-95a4832f8539 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107263) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:36:59.399694 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: INFO nova.api.openstack.compute.server_external_events [req-4cc7b76c-fe86-4485-9f8d-f94cf3361e1d req-4973f2eb-652f-4249-a1f5-95a4832f8539 service nova] Creating event network-changed:dcb6c645-5585-4723-9633-6f29ebaddeb8 for instance a6d9fd73-2a8e-4766-a108-2024b292795c on hv-cinder-78102 Jul 13 02:36:59.417715 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: Traceback (most recent call last): Jul 13 02:36:59.417866 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jul 13 02:36:59.417866 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: timer() Jul 13 02:36:59.417866 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jul 13 02:36:59.417866 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: cb(*args, **kw) Jul 13 02:36:59.417866 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 152, in _do_acquire Jul 13 02:36:59.417866 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: waiter.switch() Jul 13 02:36:59.417866 dv-cinder-781024-2-iscsi devstack@n-api.service[107263]: greenlet.error: cannot switch to a different thread Jul 13 02:36:59.450488 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-806f1f08-514c-449e-b59f-2d5b0b18acf5 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:36:59.451110 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-806f1f08-514c-449e-b59f-2d5b0b18acf5 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:36:59.457348 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-806f1f08-514c-449e-b59f-2d5b0b18acf5 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:36:59.458089 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-806f1f08-514c-449e-b59f-2d5b0b18acf5 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:36:59.459060 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-806f1f08-514c-449e-b59f-2d5b0b18acf5 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:36:59.459659 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-806f1f08-514c-449e-b59f-2d5b0b18acf5 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:36:59.463701 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:36:59.463701 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:36:59.733292 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-806f1f08-514c-449e-b59f-2d5b0b18acf5 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f53f7247a54158825bddc30b96b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8b5616059f43f097126facb22ac41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:36:59.735893 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:36:59.735893 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:36:59.742959 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-806f1f08-514c-449e-b59f-2d5b0b18acf5 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c" status: 200 len: 1272 microversion: 2.1 time: 0.296001 Jul 13 02:36:59.743687 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 515/1037] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:36:59 2021] GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c => generated 1272 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:37:00.759879 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-bad92065-4436-40b9-aa65-4120501ebbdb tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:37:00.760503 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-bad92065-4436-40b9-aa65-4120501ebbdb tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:37:00.766522 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-bad92065-4436-40b9-aa65-4120501ebbdb tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:00.766960 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-bad92065-4436-40b9-aa65-4120501ebbdb tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:00.767712 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-bad92065-4436-40b9-aa65-4120501ebbdb tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:00.768135 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-bad92065-4436-40b9-aa65-4120501ebbdb tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:00.770962 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:00.770962 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:37:00.939409 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-bad92065-4436-40b9-aa65-4120501ebbdb tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f53f7247a54158825bddc30b96b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8b5616059f43f097126facb22ac41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:37:00.941963 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:00.941963 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:37:00.948754 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-bad92065-4436-40b9-aa65-4120501ebbdb tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c" status: 200 len: 1260 microversion: 2.1 time: 0.192617 Jul 13 02:37:00.949313 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 516/1038] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:37:00 2021] GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c => generated 1260 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:37:01.971021 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-f9740552-de97-4a52-b544-f407735c98bf tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:37:01.971636 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-f9740552-de97-4a52-b544-f407735c98bf tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:37:01.977904 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f9740552-de97-4a52-b544-f407735c98bf tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:01.978390 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f9740552-de97-4a52-b544-f407735c98bf tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:01.979159 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f9740552-de97-4a52-b544-f407735c98bf tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:01.979594 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f9740552-de97-4a52-b544-f407735c98bf tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:01.982427 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:01.982427 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:37:02.153423 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-f9740552-de97-4a52-b544-f407735c98bf tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f53f7247a54158825bddc30b96b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8b5616059f43f097126facb22ac41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:37:02.156039 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:02.156039 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:37:02.163338 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-f9740552-de97-4a52-b544-f407735c98bf tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c" status: 200 len: 1260 microversion: 2.1 time: 0.195932 Jul 13 02:37:02.163909 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 517/1039] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:37:01 2021] GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c => generated 1260 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:37:02.585223 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-8c082160-688a-4b31-a8a9-3005fda409b2 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1422363802", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-96975266", "security_groups": [{"name": "tempest-secgroup-smoke-327206247"}], "block_device_mapping_v2": [{"uuid": "426d0aa2-5112-4b39-92c2-424b8cc2af8a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "afd43932-4582-4e2a-8e2b-804f55bae1f7"}]}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:37:02.688429 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.network.neutron [None req-8c082160-688a-4b31-a8a9-3005fda409b2 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] validate_networks() for [('afd43932-4582-4e2a-8e2b-804f55bae1f7', None, None, None)] {{(pid=107262) validate_networks /opt/stack/nova/nova/network/neutron.py:2374}} Jul 13 02:37:03.344644 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-8c082160-688a-4b31-a8a9-3005fda409b2 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Flavor limits 0:0:0 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 13 02:37:03.345200 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-8c082160-688a-4b31-a8a9-3005fda409b2 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Image limits 0:0:0 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 13 02:37:03.345803 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-8c082160-688a-4b31-a8a9-3005fda409b2 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Flavor pref 0:0:0 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 13 02:37:03.346151 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-8c082160-688a-4b31-a8a9-3005fda409b2 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Image pref 0:0:0 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 13 02:37:03.346617 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.virt.hardware [None req-8c082160-688a-4b31-a8a9-3005fda409b2 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=107262) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 13 02:37:03.353029 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2690: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:03.353029 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: user_quotas = model_query(context, models.ProjectUserQuota, Jul 13 02:37:03.357328 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8c082160-688a-4b31-a8a9-3005fda409b2 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:03.357777 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8c082160-688a-4b31-a8a9-3005fda409b2 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:03.358614 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8c082160-688a-4b31-a8a9-3005fda409b2 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:03.359055 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8c082160-688a-4b31-a8a9-3005fda409b2 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:03.363608 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/objects/instance.py:1537: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:03.363608 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: project_result = project_query.first() Jul 13 02:37:03.375611 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2708: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:03.375611 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: rows = model_query(context, models.Quota, read_deleted="no").\ Jul 13 02:37:03.379090 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.quota [None req-8c082160-688a-4b31-a8a9-3005fda409b2 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Getting quotas for project 345d0f5c3c2842e0940d216397b5cd51. Resources: {'ram', 'cores', 'instances'} {{(pid=107262) _get_quotas /opt/stack/nova/nova/quota.py:387}} Jul 13 02:37:03.382770 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.quota [None req-8c082160-688a-4b31-a8a9-3005fda409b2 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Getting quotas for user 2e23950a4bea4e70a2a8be2c2dd9743e and project 345d0f5c3c2842e0940d216397b5cd51. Resources: {'ram', 'cores', 'instances'} {{(pid=107262) _get_quotas /opt/stack/nova/nova/quota.py:377}} Jul 13 02:37:03.443631 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-8c082160-688a-4b31-a8a9-3005fda409b2 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Going to run 1 instances... {{(pid=107262) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Jul 13 02:37:03.446318 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-8c082160-688a-4b31-a8a9-3005fda409b2 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d582c4f0-83ee-44d8-9c24-679c870c79ba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='426d0aa2-5112-4b39-92c2-424b8cc2af8a',volume_size=None,volume_type=None)] {{(pid=107262) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Jul 13 02:37:03.566117 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-8c082160-688a-4b31-a8a9-3005fda409b2 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.984470 Jul 13 02:37:03.566753 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 518/1040] 10.222.0.32 () {60 vars in 1147 bytes} [Tue Jul 13 02:37:02 2021] POST /compute/v2.1/servers => generated 405 bytes in 986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 13 02:37:03.571545 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-afbeef41-7973-4a03-a704-76a9d650d930 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:37:03.572364 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-afbeef41-7973-4a03-a704-76a9d650d930 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:37:03.578710 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-afbeef41-7973-4a03-a704-76a9d650d930 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:03.579151 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-afbeef41-7973-4a03-a704-76a9d650d930 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:03.579910 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-afbeef41-7973-4a03-a704-76a9d650d930 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:03.580335 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-afbeef41-7973-4a03-a704-76a9d650d930 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:03.583353 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:03.583353 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:37:03.760124 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-afbeef41-7973-4a03-a704-76a9d650d930 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f53f7247a54158825bddc30b96b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8b5616059f43f097126facb22ac41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:37:03.764504 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:03.764504 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:37:03.771477 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-afbeef41-7973-4a03-a704-76a9d650d930 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c" status: 200 len: 1260 microversion: 2.1 time: 0.203715 Jul 13 02:37:03.772051 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 519/1041] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:37:03 2021] GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c => generated 1260 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:37:03.776369 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-fe82ed8a-24c3-4ba4-b442-382c3ddc7060 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:37:03.776973 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-fe82ed8a-24c3-4ba4-b442-382c3ddc7060 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d582c4f0-83ee-44d8-9c24-679c870c79ba] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:37:03.832139 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-fe82ed8a-24c3-4ba4-b442-382c3ddc7060 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:37:03.834678 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:03.834678 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:37:03.840806 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-fe82ed8a-24c3-4ba4-b442-382c3ddc7060 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/d582c4f0-83ee-44d8-9c24-679c870c79ba" status: 200 len: 1093 microversion: 2.1 time: 0.067779 Jul 13 02:37:03.841370 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 520/1042] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:37:03 2021] GET /compute/v2.1/servers/d582c4f0-83ee-44d8-9c24-679c870c79ba => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:37:04.788755 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-f07e7562-dd68-43ba-a872-ec4d08d12dee tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:37:04.789415 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-f07e7562-dd68-43ba-a872-ec4d08d12dee tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:37:04.795479 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f07e7562-dd68-43ba-a872-ec4d08d12dee tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:04.795948 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f07e7562-dd68-43ba-a872-ec4d08d12dee tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:04.796711 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f07e7562-dd68-43ba-a872-ec4d08d12dee tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:04.797146 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f07e7562-dd68-43ba-a872-ec4d08d12dee tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:04.800097 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:04.800097 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:37:05.069965 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-f07e7562-dd68-43ba-a872-ec4d08d12dee tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f53f7247a54158825bddc30b96b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8b5616059f43f097126facb22ac41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:37:05.073165 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:05.073165 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:37:05.080179 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-f07e7562-dd68-43ba-a872-ec4d08d12dee tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c" status: 200 len: 1260 microversion: 2.1 time: 0.295885 Jul 13 02:37:05.080977 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 521/1043] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:37:04 2021] GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c => generated 1260 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:37:05.085214 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-3c5428e3-2533-49e8-85c8-6c4193b7d62f tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:37:05.085837 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-3c5428e3-2533-49e8-85c8-6c4193b7d62f tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d582c4f0-83ee-44d8-9c24-679c870c79ba] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:37:05.092807 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3c5428e3-2533-49e8-85c8-6c4193b7d62f tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:05.093257 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3c5428e3-2533-49e8-85c8-6c4193b7d62f tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:05.094043 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3c5428e3-2533-49e8-85c8-6c4193b7d62f tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:05.094483 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3c5428e3-2533-49e8-85c8-6c4193b7d62f tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:05.097658 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:05.097658 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:37:05.222670 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-3c5428e3-2533-49e8-85c8-6c4193b7d62f tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:37:05.225492 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:05.225492 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:37:05.232610 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-3c5428e3-2533-49e8-85c8-6c4193b7d62f tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/d582c4f0-83ee-44d8-9c24-679c870c79ba" status: 200 len: 1209 microversion: 2.1 time: 0.150778 Jul 13 02:37:05.233179 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 522/1044] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:37:05 2021] GET /compute/v2.1/servers/d582c4f0-83ee-44d8-9c24-679c870c79ba => generated 1209 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:37:06.098582 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-30b3def7-ef20-4149-a427-9bffbd4148b8 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:37:06.099229 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-30b3def7-ef20-4149-a427-9bffbd4148b8 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:37:06.106336 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-30b3def7-ef20-4149-a427-9bffbd4148b8 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:06.106708 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-30b3def7-ef20-4149-a427-9bffbd4148b8 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:06.107597 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-30b3def7-ef20-4149-a427-9bffbd4148b8 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:06.108025 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-30b3def7-ef20-4149-a427-9bffbd4148b8 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:06.111476 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:06.111476 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:37:06.381702 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-30b3def7-ef20-4149-a427-9bffbd4148b8 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f53f7247a54158825bddc30b96b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8b5616059f43f097126facb22ac41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:37:06.385001 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:06.385001 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:37:06.392262 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-30b3def7-ef20-4149-a427-9bffbd4148b8 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c" status: 200 len: 1260 microversion: 2.1 time: 0.297413 Jul 13 02:37:06.393005 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 523/1045] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:37:06 2021] GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c => generated 1260 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:37:06.397593 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-a5f0d783-b32a-4353-b922-a01454572800 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:37:06.398219 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-a5f0d783-b32a-4353-b922-a01454572800 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d582c4f0-83ee-44d8-9c24-679c870c79ba] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:37:06.404161 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a5f0d783-b32a-4353-b922-a01454572800 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:06.404602 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a5f0d783-b32a-4353-b922-a01454572800 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:06.405360 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a5f0d783-b32a-4353-b922-a01454572800 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:06.405785 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a5f0d783-b32a-4353-b922-a01454572800 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:06.408693 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:06.408693 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:37:06.655810 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-a5f0d783-b32a-4353-b922-a01454572800 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:37:06.658455 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:06.658455 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:37:06.666759 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-a5f0d783-b32a-4353-b922-a01454572800 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/d582c4f0-83ee-44d8-9c24-679c870c79ba" status: 200 len: 1264 microversion: 2.1 time: 0.272619 Jul 13 02:37:06.668270 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 524/1046] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:37:06 2021] GET /compute/v2.1/servers/d582c4f0-83ee-44d8-9c24-679c870c79ba => generated 1264 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:37:07.408385 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-9040f811-d55a-450c-8762-1a30a843509a tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:37:07.409066 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-9040f811-d55a-450c-8762-1a30a843509a tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:37:07.414967 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9040f811-d55a-450c-8762-1a30a843509a tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:07.415429 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9040f811-d55a-450c-8762-1a30a843509a tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:07.416187 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9040f811-d55a-450c-8762-1a30a843509a tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:07.416617 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9040f811-d55a-450c-8762-1a30a843509a tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:07.419498 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:07.419498 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:37:07.588151 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-9040f811-d55a-450c-8762-1a30a843509a tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f53f7247a54158825bddc30b96b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8b5616059f43f097126facb22ac41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:37:07.590729 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:07.590729 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:37:07.597519 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-9040f811-d55a-450c-8762-1a30a843509a tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c" status: 200 len: 1260 microversion: 2.1 time: 0.192914 Jul 13 02:37:07.598114 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 525/1047] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:37:07 2021] GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c => generated 1260 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:37:07.683792 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-684bd45d-ae3a-4233-befa-0935d45ac81c tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:37:07.684398 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-684bd45d-ae3a-4233-befa-0935d45ac81c tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d582c4f0-83ee-44d8-9c24-679c870c79ba] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:37:07.689928 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-684bd45d-ae3a-4233-befa-0935d45ac81c tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:07.690407 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-684bd45d-ae3a-4233-befa-0935d45ac81c tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:07.691177 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-684bd45d-ae3a-4233-befa-0935d45ac81c tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:07.691615 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-684bd45d-ae3a-4233-befa-0935d45ac81c tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:07.694450 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:07.694450 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:37:07.865607 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-684bd45d-ae3a-4233-befa-0935d45ac81c tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:37:07.868749 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:07.868749 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:37:07.875493 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-684bd45d-ae3a-4233-befa-0935d45ac81c tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/d582c4f0-83ee-44d8-9c24-679c870c79ba" status: 200 len: 1264 microversion: 2.1 time: 0.195673 Jul 13 02:37:07.876045 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 526/1048] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:37:07 2021] GET /compute/v2.1/servers/d582c4f0-83ee-44d8-9c24-679c870c79ba => generated 1264 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:37:08.614422 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-5e5ec294-5c73-438b-964a-79aacf38c942 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:37:08.615163 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-5e5ec294-5c73-438b-964a-79aacf38c942 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:37:08.621031 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5e5ec294-5c73-438b-964a-79aacf38c942 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:08.621479 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5e5ec294-5c73-438b-964a-79aacf38c942 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:08.622289 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5e5ec294-5c73-438b-964a-79aacf38c942 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:08.622718 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-5e5ec294-5c73-438b-964a-79aacf38c942 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:08.625525 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:08.625525 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:37:08.798204 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-5e5ec294-5c73-438b-964a-79aacf38c942 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f53f7247a54158825bddc30b96b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8b5616059f43f097126facb22ac41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:37:08.800826 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:08.800826 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:37:08.808197 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-5e5ec294-5c73-438b-964a-79aacf38c942 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c" status: 200 len: 1260 microversion: 2.1 time: 0.197458 Jul 13 02:37:08.808780 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 527/1049] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:37:08 2021] GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c => generated 1260 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:37:08.892716 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-b7160a76-73be-41e7-b9f9-de1868373166 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:37:08.893278 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-b7160a76-73be-41e7-b9f9-de1868373166 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d582c4f0-83ee-44d8-9c24-679c870c79ba] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:37:08.899758 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b7160a76-73be-41e7-b9f9-de1868373166 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:08.900205 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b7160a76-73be-41e7-b9f9-de1868373166 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:08.900984 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b7160a76-73be-41e7-b9f9-de1868373166 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:08.901443 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b7160a76-73be-41e7-b9f9-de1868373166 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:08.904368 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:08.904368 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:37:09.084932 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-b7160a76-73be-41e7-b9f9-de1868373166 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:37:09.088246 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:09.088246 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:37:09.095475 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-b7160a76-73be-41e7-b9f9-de1868373166 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/d582c4f0-83ee-44d8-9c24-679c870c79ba" status: 200 len: 1264 microversion: 2.1 time: 0.206820 Jul 13 02:37:09.096055 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 528/1050] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:37:08 2021] GET /compute/v2.1/servers/d582c4f0-83ee-44d8-9c24-679c870c79ba => generated 1264 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:37:09.825618 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-c7d0530f-16bb-466e-96fd-92f2a6f8a7c1 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:37:09.826309 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-c7d0530f-16bb-466e-96fd-92f2a6f8a7c1 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:37:09.831952 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c7d0530f-16bb-466e-96fd-92f2a6f8a7c1 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:09.832409 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c7d0530f-16bb-466e-96fd-92f2a6f8a7c1 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:09.833156 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c7d0530f-16bb-466e-96fd-92f2a6f8a7c1 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:09.833587 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c7d0530f-16bb-466e-96fd-92f2a6f8a7c1 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:09.836500 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:09.836500 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:37:10.010987 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-c7d0530f-16bb-466e-96fd-92f2a6f8a7c1 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f53f7247a54158825bddc30b96b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8b5616059f43f097126facb22ac41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:37:10.013856 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:10.013856 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:37:10.020661 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-c7d0530f-16bb-466e-96fd-92f2a6f8a7c1 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c" status: 200 len: 1260 microversion: 2.1 time: 0.198809 Jul 13 02:37:10.021217 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 529/1051] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:37:09 2021] GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c => generated 1260 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:37:10.111982 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-b7c57e99-03b9-489d-9378-882abb2748d1 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:37:10.112510 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-b7c57e99-03b9-489d-9378-882abb2748d1 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d582c4f0-83ee-44d8-9c24-679c870c79ba] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:37:10.119094 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b7c57e99-03b9-489d-9378-882abb2748d1 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:10.119530 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b7c57e99-03b9-489d-9378-882abb2748d1 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:10.120283 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b7c57e99-03b9-489d-9378-882abb2748d1 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:10.120707 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b7c57e99-03b9-489d-9378-882abb2748d1 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:10.123505 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:10.123505 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:37:10.291004 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-b7c57e99-03b9-489d-9378-882abb2748d1 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:37:10.293534 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:10.293534 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:37:10.300331 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-b7c57e99-03b9-489d-9378-882abb2748d1 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/d582c4f0-83ee-44d8-9c24-679c870c79ba" status: 200 len: 1264 microversion: 2.1 time: 0.191787 Jul 13 02:37:10.300894 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 530/1052] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:37:10 2021] GET /compute/v2.1/servers/d582c4f0-83ee-44d8-9c24-679c870c79ba => generated 1264 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:37:11.000635 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-e4f110ce-9047-4c45-89a1-8f4b317e8785 req-eec806ff-c486-4ce7-b871-2407905f3cc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d9fd73-2a8e-4766-a108-2024b292795c", "name": "network-vif-plugged", "status": "completed", "tag": "dcb6c645-5585-4723-9633-6f29ebaddeb8"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:37:11.002773 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:37:11.002773 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:37:11.010735 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-e4f110ce-9047-4c45-89a1-8f4b317e8785 req-eec806ff-c486-4ce7-b871-2407905f3cc0 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:11.011220 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-e4f110ce-9047-4c45-89a1-8f4b317e8785 req-eec806ff-c486-4ce7-b871-2407905f3cc0 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:11.024654 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-e4f110ce-9047-4c45-89a1-8f4b317e8785 req-eec806ff-c486-4ce7-b871-2407905f3cc0 service nova] Creating event network-vif-plugged:dcb6c645-5585-4723-9633-6f29ebaddeb8 for instance a6d9fd73-2a8e-4766-a108-2024b292795c on hv-cinder-78102 Jul 13 02:37:11.030735 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-e4f110ce-9047-4c45-89a1-8f4b317e8785 req-eec806ff-c486-4ce7-b871-2407905f3cc0 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034454 Jul 13 02:37:11.031673 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 531/1053] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:37:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 02:37:11.039625 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-7c44df66-427f-4563-8970-ca660f1d704c tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:37:11.040667 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-7c44df66-427f-4563-8970-ca660f1d704c tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:37:11.049043 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7c44df66-427f-4563-8970-ca660f1d704c tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:11.049527 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7c44df66-427f-4563-8970-ca660f1d704c tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:11.050531 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7c44df66-427f-4563-8970-ca660f1d704c tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:11.050976 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7c44df66-427f-4563-8970-ca660f1d704c tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:11.054220 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:11.054220 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:37:11.386388 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-7c44df66-427f-4563-8970-ca660f1d704c tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f53f7247a54158825bddc30b96b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8b5616059f43f097126facb22ac41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:37:11.389407 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:11.389407 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:37:11.396756 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-7c44df66-427f-4563-8970-ca660f1d704c tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c" status: 200 len: 1260 microversion: 2.1 time: 0.362534 Jul 13 02:37:11.397330 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 532/1054] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:37:11 2021] GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c => generated 1260 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:37:11.402484 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-d80d6606-2920-4a0e-b6e6-a49b30217e44 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:37:11.403087 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-d80d6606-2920-4a0e-b6e6-a49b30217e44 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d582c4f0-83ee-44d8-9c24-679c870c79ba] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:37:11.408624 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d80d6606-2920-4a0e-b6e6-a49b30217e44 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:11.409215 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d80d6606-2920-4a0e-b6e6-a49b30217e44 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:11.410245 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d80d6606-2920-4a0e-b6e6-a49b30217e44 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:11.410846 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d80d6606-2920-4a0e-b6e6-a49b30217e44 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:11.413726 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:11.413726 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:37:11.581755 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-d80d6606-2920-4a0e-b6e6-a49b30217e44 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:37:11.584297 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:11.584297 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:37:11.591715 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-d80d6606-2920-4a0e-b6e6-a49b30217e44 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/d582c4f0-83ee-44d8-9c24-679c870c79ba" status: 200 len: 1264 microversion: 2.1 time: 0.193450 Jul 13 02:37:11.592281 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 533/1055] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:37:11 2021] GET /compute/v2.1/servers/d582c4f0-83ee-44d8-9c24-679c870c79ba => generated 1264 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:37:12.414175 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-c596bb6e-a4ad-4782-905e-d40b6c28ec36 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:37:12.414822 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-c596bb6e-a4ad-4782-905e-d40b6c28ec36 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:37:12.420501 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c596bb6e-a4ad-4782-905e-d40b6c28ec36 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:12.420944 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c596bb6e-a4ad-4782-905e-d40b6c28ec36 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:12.421692 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c596bb6e-a4ad-4782-905e-d40b6c28ec36 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:12.422153 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c596bb6e-a4ad-4782-905e-d40b6c28ec36 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:12.424932 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:12.424932 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:37:12.603175 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-c596bb6e-a4ad-4782-905e-d40b6c28ec36 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f53f7247a54158825bddc30b96b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8b5616059f43f097126facb22ac41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:37:12.606336 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:12.606336 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:37:12.614303 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-c596bb6e-a4ad-4782-905e-d40b6c28ec36 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c" status: 200 len: 1260 microversion: 2.1 time: 0.204069 Jul 13 02:37:12.614869 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 534/1056] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:37:12 2021] GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c => generated 1260 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:37:12.619896 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-92c47cb0-acfb-442e-a5b3-a7b8cdaa49cc tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:37:12.620487 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-92c47cb0-acfb-442e-a5b3-a7b8cdaa49cc tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d582c4f0-83ee-44d8-9c24-679c870c79ba] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:37:12.626303 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-92c47cb0-acfb-442e-a5b3-a7b8cdaa49cc tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:12.626774 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-92c47cb0-acfb-442e-a5b3-a7b8cdaa49cc tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:12.627532 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-92c47cb0-acfb-442e-a5b3-a7b8cdaa49cc tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:12.627960 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-92c47cb0-acfb-442e-a5b3-a7b8cdaa49cc tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:12.630808 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:12.630808 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:37:12.798224 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-92c47cb0-acfb-442e-a5b3-a7b8cdaa49cc tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:37:12.800785 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:12.800785 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:37:12.808225 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-92c47cb0-acfb-442e-a5b3-a7b8cdaa49cc tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/d582c4f0-83ee-44d8-9c24-679c870c79ba" status: 200 len: 1264 microversion: 2.1 time: 0.192400 Jul 13 02:37:12.808785 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 535/1057] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:37:12 2021] GET /compute/v2.1/servers/d582c4f0-83ee-44d8-9c24-679c870c79ba => generated 1264 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:37:13.632903 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-84e3c13c-c748-4d91-87f9-08d80298dc9c tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:37:13.633752 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-84e3c13c-c748-4d91-87f9-08d80298dc9c tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:37:13.640267 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-84e3c13c-c748-4d91-87f9-08d80298dc9c tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:13.640714 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-84e3c13c-c748-4d91-87f9-08d80298dc9c tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:13.641687 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-84e3c13c-c748-4d91-87f9-08d80298dc9c tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:13.642160 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-84e3c13c-c748-4d91-87f9-08d80298dc9c tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:13.645110 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:13.645110 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:37:13.818509 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-84e3c13c-c748-4d91-87f9-08d80298dc9c tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f53f7247a54158825bddc30b96b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8b5616059f43f097126facb22ac41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:37:13.821356 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:13.821356 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:37:13.828192 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-84e3c13c-c748-4d91-87f9-08d80298dc9c tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c" status: 200 len: 1444 microversion: 2.1 time: 0.198985 Jul 13 02:37:13.828757 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 536/1058] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:37:13 2021] GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c => generated 1444 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:37:13.832914 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-4ae04be4-5ad6-4dd9-b2cb-cbdf5567122b tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:37:13.833513 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-4ae04be4-5ad6-4dd9-b2cb-cbdf5567122b tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d582c4f0-83ee-44d8-9c24-679c870c79ba] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:37:13.839002 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-4ae04be4-5ad6-4dd9-b2cb-cbdf5567122b tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:13.839447 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-4ae04be4-5ad6-4dd9-b2cb-cbdf5567122b tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:13.840208 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-4ae04be4-5ad6-4dd9-b2cb-cbdf5567122b tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:13.840640 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-4ae04be4-5ad6-4dd9-b2cb-cbdf5567122b tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:13.843496 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:13.843496 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:37:14.020836 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-4ae04be4-5ad6-4dd9-b2cb-cbdf5567122b tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:37:14.023414 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:14.023414 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:37:14.030351 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-4ae04be4-5ad6-4dd9-b2cb-cbdf5567122b tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/d582c4f0-83ee-44d8-9c24-679c870c79ba" status: 200 len: 1264 microversion: 2.1 time: 0.200625 Jul 13 02:37:14.030909 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 537/1059] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:37:13 2021] GET /compute/v2.1/servers/d582c4f0-83ee-44d8-9c24-679c870c79ba => generated 1264 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:37:14.035100 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-40714336-00de-4f3c-95fc-986f67583daa tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:37:14.035702 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-40714336-00de-4f3c-95fc-986f67583daa tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:37:14.041706 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-40714336-00de-4f3c-95fc-986f67583daa tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:14.042195 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-40714336-00de-4f3c-95fc-986f67583daa tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:14.042971 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-40714336-00de-4f3c-95fc-986f67583daa tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:14.043407 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-40714336-00de-4f3c-95fc-986f67583daa tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:14.046499 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:14.046499 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:37:14.221441 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-40714336-00de-4f3c-95fc-986f67583daa tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f53f7247a54158825bddc30b96b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8b5616059f43f097126facb22ac41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:37:14.224020 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:14.224020 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:37:14.231557 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-40714336-00de-4f3c-95fc-986f67583daa tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c" status: 200 len: 1444 microversion: 2.1 time: 0.199717 Jul 13 02:37:14.232119 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 538/1060] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:37:14 2021] GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c => generated 1444 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:37:15.119536 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-2824c325-c9fd-4a02-ba42-494b70571388 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:37:15.120279 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-2824c325-c9fd-4a02-ba42-494b70571388 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d582c4f0-83ee-44d8-9c24-679c870c79ba] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:37:15.126427 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2824c325-c9fd-4a02-ba42-494b70571388 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:15.126937 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2824c325-c9fd-4a02-ba42-494b70571388 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:15.127775 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2824c325-c9fd-4a02-ba42-494b70571388 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:15.128449 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-2824c325-c9fd-4a02-ba42-494b70571388 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:15.131627 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:15.131627 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:37:15.316276 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-2824c325-c9fd-4a02-ba42-494b70571388 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:37:15.318992 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:15.318992 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:37:15.326992 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-2824c325-c9fd-4a02-ba42-494b70571388 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/d582c4f0-83ee-44d8-9c24-679c870c79ba" status: 200 len: 1264 microversion: 2.1 time: 0.282851 Jul 13 02:37:15.327661 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 539/1061] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:37:15 2021] GET /compute/v2.1/servers/d582c4f0-83ee-44d8-9c24-679c870c79ba => generated 1264 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:37:15.930842 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-d36c7d3a-4b16-4f8d-873e-5aad78354033 req-c92f9e73-8488-459b-ac30-6e69f4a60038 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6d9fd73-2a8e-4766-a108-2024b292795c", "tag": "dcb6c645-5585-4723-9633-6f29ebaddeb8"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:37:15.932595 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:37:15.932595 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:37:15.939718 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-d36c7d3a-4b16-4f8d-873e-5aad78354033 req-c92f9e73-8488-459b-ac30-6e69f4a60038 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:15.940235 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-d36c7d3a-4b16-4f8d-873e-5aad78354033 req-c92f9e73-8488-459b-ac30-6e69f4a60038 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:15.951717 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-d36c7d3a-4b16-4f8d-873e-5aad78354033 req-c92f9e73-8488-459b-ac30-6e69f4a60038 service nova] Creating event network-changed:dcb6c645-5585-4723-9633-6f29ebaddeb8 for instance a6d9fd73-2a8e-4766-a108-2024b292795c on hv-cinder-78102 Jul 13 02:37:15.956599 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-d36c7d3a-4b16-4f8d-873e-5aad78354033 req-c92f9e73-8488-459b-ac30-6e69f4a60038 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029641 Jul 13 02:37:15.957183 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 540/1062] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:37:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 02:37:16.344490 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-d9071a80-8489-496e-92d8-94f150110ecd tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:37:16.345894 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-d9071a80-8489-496e-92d8-94f150110ecd tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d582c4f0-83ee-44d8-9c24-679c870c79ba] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:37:16.351962 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d9071a80-8489-496e-92d8-94f150110ecd tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:16.352400 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d9071a80-8489-496e-92d8-94f150110ecd tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:16.353840 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d9071a80-8489-496e-92d8-94f150110ecd tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:16.354552 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d9071a80-8489-496e-92d8-94f150110ecd tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:16.357590 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:16.357590 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:37:16.627622 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-d9071a80-8489-496e-92d8-94f150110ecd tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:37:16.630299 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:16.630299 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:37:16.638660 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-d9071a80-8489-496e-92d8-94f150110ecd tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/d582c4f0-83ee-44d8-9c24-679c870c79ba" status: 200 len: 1264 microversion: 2.1 time: 0.298106 Jul 13 02:37:16.639336 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 541/1063] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:37:16 2021] GET /compute/v2.1/servers/d582c4f0-83ee-44d8-9c24-679c870c79ba => generated 1264 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:37:17.021856 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-bf1d1476-b3ed-41c3-a7fc-c04db364ae8c req-31c4a311-bab2-4294-add8-ba0308247d0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d582c4f0-83ee-44d8-9c24-679c870c79ba", "name": "network-vif-plugged", "status": "completed", "tag": "bfbda5b3-4dd0-4554-96bb-91ee7c0e20c0"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:37:17.023368 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:37:17.023368 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:37:17.031297 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-bf1d1476-b3ed-41c3-a7fc-c04db364ae8c req-31c4a311-bab2-4294-add8-ba0308247d0f service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:17.031751 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-bf1d1476-b3ed-41c3-a7fc-c04db364ae8c req-31c4a311-bab2-4294-add8-ba0308247d0f service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:17.043285 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-bf1d1476-b3ed-41c3-a7fc-c04db364ae8c req-31c4a311-bab2-4294-add8-ba0308247d0f service nova] Creating event network-vif-plugged:bfbda5b3-4dd0-4554-96bb-91ee7c0e20c0 for instance d582c4f0-83ee-44d8-9c24-679c870c79ba on hv-cinder-78102 Jul 13 02:37:17.047959 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-bf1d1476-b3ed-41c3-a7fc-c04db364ae8c req-31c4a311-bab2-4294-add8-ba0308247d0f service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029764 Jul 13 02:37:17.048569 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 542/1064] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:37:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 02:37:17.656799 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-b2354ab2-4541-415b-8ebc-48e06b856899 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:37:17.657411 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-b2354ab2-4541-415b-8ebc-48e06b856899 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d582c4f0-83ee-44d8-9c24-679c870c79ba] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:37:17.663452 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b2354ab2-4541-415b-8ebc-48e06b856899 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:17.663893 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b2354ab2-4541-415b-8ebc-48e06b856899 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:17.664641 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b2354ab2-4541-415b-8ebc-48e06b856899 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:17.665059 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b2354ab2-4541-415b-8ebc-48e06b856899 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:17.668521 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:17.668521 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:37:17.838109 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-b2354ab2-4541-415b-8ebc-48e06b856899 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:37:17.840678 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:17.840678 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:37:17.847709 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-b2354ab2-4541-415b-8ebc-48e06b856899 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/d582c4f0-83ee-44d8-9c24-679c870c79ba" status: 200 len: 1264 microversion: 2.1 time: 0.194871 Jul 13 02:37:17.848281 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 543/1065] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:37:17 2021] GET /compute/v2.1/servers/d582c4f0-83ee-44d8-9c24-679c870c79ba => generated 1264 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:37:18.864662 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-8f284dd9-104c-41db-b0f0-b11720ab5804 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:37:18.865338 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-8f284dd9-104c-41db-b0f0-b11720ab5804 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d582c4f0-83ee-44d8-9c24-679c870c79ba] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:37:18.871880 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8f284dd9-104c-41db-b0f0-b11720ab5804 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:18.872320 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8f284dd9-104c-41db-b0f0-b11720ab5804 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:18.873075 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8f284dd9-104c-41db-b0f0-b11720ab5804 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:18.873498 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8f284dd9-104c-41db-b0f0-b11720ab5804 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:18.876312 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:18.876312 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:37:19.046937 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-8f284dd9-104c-41db-b0f0-b11720ab5804 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:37:19.049483 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:19.049483 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:37:19.056286 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-8f284dd9-104c-41db-b0f0-b11720ab5804 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/d582c4f0-83ee-44d8-9c24-679c870c79ba" status: 200 len: 1452 microversion: 2.1 time: 0.195315 Jul 13 02:37:19.057557 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 544/1066] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:37:18 2021] GET /compute/v2.1/servers/d582c4f0-83ee-44d8-9c24-679c870c79ba => generated 1452 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:37:19.072098 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-55c26d59-f396-405c-93bd-8c5e87247050 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:37:19.072779 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-55c26d59-f396-405c-93bd-8c5e87247050 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d582c4f0-83ee-44d8-9c24-679c870c79ba] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:37:19.078242 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-55c26d59-f396-405c-93bd-8c5e87247050 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:19.078687 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-55c26d59-f396-405c-93bd-8c5e87247050 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:19.079449 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-55c26d59-f396-405c-93bd-8c5e87247050 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:37:19.079879 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-55c26d59-f396-405c-93bd-8c5e87247050 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:37:19.082668 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:19.082668 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:37:19.251791 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-55c26d59-f396-405c-93bd-8c5e87247050 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:37:19.254390 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:37:19.254390 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:37:19.261185 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-55c26d59-f396-405c-93bd-8c5e87247050 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/d582c4f0-83ee-44d8-9c24-679c870c79ba" status: 200 len: 1452 microversion: 2.1 time: 0.192410 Jul 13 02:37:19.261750 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 545/1067] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:37:19 2021] GET /compute/v2.1/servers/d582c4f0-83ee-44d8-9c24-679c870c79ba => generated 1452 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:38:46.508858 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 13 02:38:46.509429 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: Tue Jul 13 02:38:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 13 02:38:53.908618 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-97fc572a-10dc-4305-b039-4c468b8fe7c9 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:38:53.909240 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-97fc572a-10dc-4305-b039-4c468b8fe7c9 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d582c4f0-83ee-44d8-9c24-679c870c79ba] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:38:53.915632 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-97fc572a-10dc-4305-b039-4c468b8fe7c9 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:38:53.916076 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-97fc572a-10dc-4305-b039-4c468b8fe7c9 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:38:53.916844 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-97fc572a-10dc-4305-b039-4c468b8fe7c9 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:38:53.917272 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-97fc572a-10dc-4305-b039-4c468b8fe7c9 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:38:53.920089 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:38:53.920089 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:38:53.986476 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-97fc572a-10dc-4305-b039-4c468b8fe7c9 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d582c4f0-83ee-44d8-9c24-679c870c79ba] Going to try to terminate instance {{(pid=107262) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 13 02:38:53.988903 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3008: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:38:53.988903 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).\ Jul 13 02:38:54.001998 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:38:54.001998 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:38:54.058405 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/update_match.py:472: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:38:54.058405 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = query.session.execute(update_stmt) Jul 13 02:38:54.075041 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:530: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:38:54.075041 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = model_query(context, models.Service, read_deleted="no").\ Jul 13 02:38:54.109383 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-97fc572a-10dc-4305-b039-4c468b8fe7c9 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "DELETE /compute/v2.1/servers/d582c4f0-83ee-44d8-9c24-679c870c79ba" status: 204 len: 0 microversion: 2.1 time: 0.205691 Jul 13 02:38:54.109954 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 546/1068] 10.222.0.32 () {58 vars in 1239 bytes} [Tue Jul 13 02:38:53 2021] DELETE /compute/v2.1/servers/d582c4f0-83ee-44d8-9c24-679c870c79ba => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 13 02:38:54.118881 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-1ed666b9-a66e-4190-9ef7-edcac41f051d tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:38:54.119561 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-1ed666b9-a66e-4190-9ef7-edcac41f051d tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d582c4f0-83ee-44d8-9c24-679c870c79ba] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:38:54.125169 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1ed666b9-a66e-4190-9ef7-edcac41f051d tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:38:54.125610 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1ed666b9-a66e-4190-9ef7-edcac41f051d tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:38:54.126915 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1ed666b9-a66e-4190-9ef7-edcac41f051d tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:38:54.127342 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-1ed666b9-a66e-4190-9ef7-edcac41f051d tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:38:54.130168 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:38:54.130168 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:38:54.303212 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-1ed666b9-a66e-4190-9ef7-edcac41f051d tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:38:54.305789 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:38:54.305789 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:38:54.312758 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-1ed666b9-a66e-4190-9ef7-edcac41f051d tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/d582c4f0-83ee-44d8-9c24-679c870c79ba" status: 200 len: 1458 microversion: 2.1 time: 0.198188 Jul 13 02:38:54.313930 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 547/1069] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:38:54 2021] GET /compute/v2.1/servers/d582c4f0-83ee-44d8-9c24-679c870c79ba => generated 1458 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:38:55.330263 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-0fc028ba-a69d-46c8-ba80-bac3e7be5c64 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:38:55.330938 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-0fc028ba-a69d-46c8-ba80-bac3e7be5c64 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d582c4f0-83ee-44d8-9c24-679c870c79ba] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:38:55.336637 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-0fc028ba-a69d-46c8-ba80-bac3e7be5c64 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:38:55.337080 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-0fc028ba-a69d-46c8-ba80-bac3e7be5c64 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:38:55.337839 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-0fc028ba-a69d-46c8-ba80-bac3e7be5c64 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:38:55.338293 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-0fc028ba-a69d-46c8-ba80-bac3e7be5c64 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:38:55.341111 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:38:55.341111 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:38:55.512353 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-0fc028ba-a69d-46c8-ba80-bac3e7be5c64 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:38:55.515011 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:38:55.515011 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:38:55.521792 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-0fc028ba-a69d-46c8-ba80-bac3e7be5c64 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/d582c4f0-83ee-44d8-9c24-679c870c79ba" status: 200 len: 1458 microversion: 2.1 time: 0.195347 Jul 13 02:38:55.522391 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 548/1070] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:38:55 2021] GET /compute/v2.1/servers/d582c4f0-83ee-44d8-9c24-679c870c79ba => generated 1458 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:38:56.538905 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-046d6cf7-a5fb-4ee4-b397-c1f47757b5b8 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:38:56.539519 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-046d6cf7-a5fb-4ee4-b397-c1f47757b5b8 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d582c4f0-83ee-44d8-9c24-679c870c79ba] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:38:56.545234 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-046d6cf7-a5fb-4ee4-b397-c1f47757b5b8 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:38:56.545675 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-046d6cf7-a5fb-4ee4-b397-c1f47757b5b8 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:38:56.546460 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-046d6cf7-a5fb-4ee4-b397-c1f47757b5b8 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:38:56.546893 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-046d6cf7-a5fb-4ee4-b397-c1f47757b5b8 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:38:56.550442 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:38:56.550442 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:38:56.659514 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-046d6cf7-a5fb-4ee4-b397-c1f47757b5b8 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:38:56.662212 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:38:56.662212 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:38:56.669884 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-046d6cf7-a5fb-4ee4-b397-c1f47757b5b8 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/d582c4f0-83ee-44d8-9c24-679c870c79ba" status: 200 len: 1224 microversion: 2.1 time: 0.134617 Jul 13 02:38:56.670758 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 549/1071] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:38:56 2021] GET /compute/v2.1/servers/d582c4f0-83ee-44d8-9c24-679c870c79ba => generated 1224 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:38:57.686559 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-f5d4aa83-6960-4484-83f1-13722b79fa50 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:38:57.687156 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-f5d4aa83-6960-4484-83f1-13722b79fa50 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d582c4f0-83ee-44d8-9c24-679c870c79ba] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:38:57.693790 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f5d4aa83-6960-4484-83f1-13722b79fa50 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:38:57.694256 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f5d4aa83-6960-4484-83f1-13722b79fa50 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:38:57.695012 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f5d4aa83-6960-4484-83f1-13722b79fa50 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:38:57.695438 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f5d4aa83-6960-4484-83f1-13722b79fa50 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:38:57.698201 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:38:57.698201 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:38:57.741825 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.wsgi [None req-f5d4aa83-6960-4484-83f1-13722b79fa50 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] HTTP exception thrown: Instance d582c4f0-83ee-44d8-9c24-679c870c79ba could not be found. Jul 13 02:38:57.742420 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-f5d4aa83-6960-4484-83f1-13722b79fa50 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Returning 404 to user: Instance d582c4f0-83ee-44d8-9c24-679c870c79ba could not be found. {{(pid=107262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:38:57.743227 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-f5d4aa83-6960-4484-83f1-13722b79fa50 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/d582c4f0-83ee-44d8-9c24-679c870c79ba" status: 404 len: 111 microversion: 2.1 time: 0.060349 Jul 13 02:38:57.743746 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 550/1072] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:38:57 2021] GET /compute/v2.1/servers/d582c4f0-83ee-44d8-9c24-679c870c79ba => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 13 02:39:00.774371 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-ea83e2be-049e-41b3-9707-e0a698b4fa39 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:39:00.774973 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-ea83e2be-049e-41b3-9707-e0a698b4fa39 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: 7d96b396-3586-4250-aa00-46948258c2bd] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:39:00.780748 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ea83e2be-049e-41b3-9707-e0a698b4fa39 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:00.781186 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ea83e2be-049e-41b3-9707-e0a698b4fa39 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:00.782620 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ea83e2be-049e-41b3-9707-e0a698b4fa39 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:00.783244 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ea83e2be-049e-41b3-9707-e0a698b4fa39 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:00.786134 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:00.786134 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:39:00.847734 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-ea83e2be-049e-41b3-9707-e0a698b4fa39 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: 7d96b396-3586-4250-aa00-46948258c2bd] Going to try to terminate instance {{(pid=107262) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 13 02:39:00.849905 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3008: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:00.849905 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).\ Jul 13 02:39:00.863023 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:00.863023 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:39:00.919922 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/update_match.py:472: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:00.919922 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = query.session.execute(update_stmt) Jul 13 02:39:00.935568 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:530: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:00.935568 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = model_query(context, models.Service, read_deleted="no").\ Jul 13 02:39:00.976369 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-ea83e2be-049e-41b3-9707-e0a698b4fa39 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "DELETE /compute/v2.1/servers/7d96b396-3586-4250-aa00-46948258c2bd" status: 204 len: 0 microversion: 2.1 time: 0.205332 Jul 13 02:39:00.977053 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 551/1073] 10.222.0.32 () {58 vars in 1239 bytes} [Tue Jul 13 02:39:00 2021] DELETE /compute/v2.1/servers/7d96b396-3586-4250-aa00-46948258c2bd => generated 0 bytes in 207 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 13 02:39:00.986245 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-e387c5e2-c668-4f2d-933d-bbb347c6b51e tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:39:00.987061 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-e387c5e2-c668-4f2d-933d-bbb347c6b51e tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: 7d96b396-3586-4250-aa00-46948258c2bd] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:39:00.993859 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e387c5e2-c668-4f2d-933d-bbb347c6b51e tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:00.994430 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e387c5e2-c668-4f2d-933d-bbb347c6b51e tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:00.995423 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e387c5e2-c668-4f2d-933d-bbb347c6b51e tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:00.996096 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-e387c5e2-c668-4f2d-933d-bbb347c6b51e tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:00.999594 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:00.999594 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:39:01.195082 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-e387c5e2-c668-4f2d-933d-bbb347c6b51e tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:39:01.197642 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:01.197642 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:39:01.205485 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-e387c5e2-c668-4f2d-933d-bbb347c6b51e tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/7d96b396-3586-4250-aa00-46948258c2bd" status: 200 len: 1574 microversion: 2.1 time: 0.224145 Jul 13 02:39:01.206274 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 552/1074] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:39:00 2021] GET /compute/v2.1/servers/7d96b396-3586-4250-aa00-46948258c2bd => generated 1574 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:39:02.223324 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-79e81cda-2aee-45ec-b571-69b63a246cf1 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:39:02.223970 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-79e81cda-2aee-45ec-b571-69b63a246cf1 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: 7d96b396-3586-4250-aa00-46948258c2bd] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:39:02.229655 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-79e81cda-2aee-45ec-b571-69b63a246cf1 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:02.230135 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-79e81cda-2aee-45ec-b571-69b63a246cf1 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:02.230901 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-79e81cda-2aee-45ec-b571-69b63a246cf1 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:02.231337 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-79e81cda-2aee-45ec-b571-69b63a246cf1 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:02.234165 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:02.234165 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:39:02.403417 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-79e81cda-2aee-45ec-b571-69b63a246cf1 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:39:02.405943 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:02.405943 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:39:02.412934 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-79e81cda-2aee-45ec-b571-69b63a246cf1 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/7d96b396-3586-4250-aa00-46948258c2bd" status: 200 len: 1574 microversion: 2.1 time: 0.194252 Jul 13 02:39:02.413499 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 553/1075] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:39:02 2021] GET /compute/v2.1/servers/7d96b396-3586-4250-aa00-46948258c2bd => generated 1574 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:39:03.429408 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-3d703aa6-43e3-443b-927d-33b2fcc7fd58 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:39:03.430045 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-3d703aa6-43e3-443b-927d-33b2fcc7fd58 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: 7d96b396-3586-4250-aa00-46948258c2bd] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:39:03.435815 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3d703aa6-43e3-443b-927d-33b2fcc7fd58 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:03.436375 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3d703aa6-43e3-443b-927d-33b2fcc7fd58 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:03.437136 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3d703aa6-43e3-443b-927d-33b2fcc7fd58 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:03.437651 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3d703aa6-43e3-443b-927d-33b2fcc7fd58 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:03.440615 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:03.440615 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:39:03.539300 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-3d703aa6-43e3-443b-927d-33b2fcc7fd58 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e23950a4bea4e70a2a8be2c2dd9743e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '345d0f5c3c2842e0940d216397b5cd51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:39:03.541756 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:03.541756 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:39:03.548538 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-3d703aa6-43e3-443b-927d-33b2fcc7fd58 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/7d96b396-3586-4250-aa00-46948258c2bd" status: 200 len: 1222 microversion: 2.1 time: 0.122759 Jul 13 02:39:03.549094 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 554/1076] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:39:03 2021] GET /compute/v2.1/servers/7d96b396-3586-4250-aa00-46948258c2bd => generated 1222 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:39:04.565073 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-b2a259eb-4ddb-4631-81ea-63d58851f0b8 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:39:04.565714 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-b2a259eb-4ddb-4631-81ea-63d58851f0b8 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: 7d96b396-3586-4250-aa00-46948258c2bd] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:39:04.571538 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b2a259eb-4ddb-4631-81ea-63d58851f0b8 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:04.571980 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b2a259eb-4ddb-4631-81ea-63d58851f0b8 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:04.572743 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b2a259eb-4ddb-4631-81ea-63d58851f0b8 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:04.573174 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b2a259eb-4ddb-4631-81ea-63d58851f0b8 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:04.576066 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:04.576066 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:39:04.620943 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.wsgi [None req-b2a259eb-4ddb-4631-81ea-63d58851f0b8 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] HTTP exception thrown: Instance 7d96b396-3586-4250-aa00-46948258c2bd could not be found. Jul 13 02:39:04.621534 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-b2a259eb-4ddb-4631-81ea-63d58851f0b8 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Returning 404 to user: Instance 7d96b396-3586-4250-aa00-46948258c2bd could not be found. {{(pid=107262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:39:04.622390 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-b2a259eb-4ddb-4631-81ea-63d58851f0b8 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/7d96b396-3586-4250-aa00-46948258c2bd" status: 404 len: 111 microversion: 2.1 time: 0.061081 Jul 13 02:39:04.622931 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 555/1077] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:39:04 2021] GET /compute/v2.1/servers/7d96b396-3586-4250-aa00-46948258c2bd => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 13 02:39:05.053778 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-8d9caafe-be89-4f04-9fcd-c21dedbf562e tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:39:05.054334 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-8d9caafe-be89-4f04-9fcd-c21dedbf562e tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d57716e0-3826-4e42-ad25-42cd46585692] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:39:05.060104 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8d9caafe-be89-4f04-9fcd-c21dedbf562e tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:05.060554 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8d9caafe-be89-4f04-9fcd-c21dedbf562e tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:05.061320 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8d9caafe-be89-4f04-9fcd-c21dedbf562e tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:05.061753 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8d9caafe-be89-4f04-9fcd-c21dedbf562e tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:05.064656 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:05.064656 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:39:05.108501 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.wsgi [None req-8d9caafe-be89-4f04-9fcd-c21dedbf562e tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] HTTP exception thrown: Instance d57716e0-3826-4e42-ad25-42cd46585692 could not be found. Jul 13 02:39:05.109020 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-8d9caafe-be89-4f04-9fcd-c21dedbf562e tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Returning 404 to user: Instance d57716e0-3826-4e42-ad25-42cd46585692 could not be found. {{(pid=107262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:39:05.109958 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-8d9caafe-be89-4f04-9fcd-c21dedbf562e tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "DELETE /compute/v2.1/servers/d57716e0-3826-4e42-ad25-42cd46585692" status: 404 len: 111 microversion: 2.1 time: 0.059818 Jul 13 02:39:05.110547 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 556/1078] 10.222.0.32 () {58 vars in 1239 bytes} [Tue Jul 13 02:39:05 2021] DELETE /compute/v2.1/servers/d57716e0-3826-4e42-ad25-42cd46585692 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 13 02:39:05.117830 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-7b8fef02-1dcc-46db-8933-d8705e62bb5c tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:39:05.118463 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-7b8fef02-1dcc-46db-8933-d8705e62bb5c tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] [instance: d57716e0-3826-4e42-ad25-42cd46585692] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:39:05.123896 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7b8fef02-1dcc-46db-8933-d8705e62bb5c tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:05.124345 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7b8fef02-1dcc-46db-8933-d8705e62bb5c tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:05.125111 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7b8fef02-1dcc-46db-8933-d8705e62bb5c tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:05.125597 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-7b8fef02-1dcc-46db-8933-d8705e62bb5c tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:05.128589 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:05.128589 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:39:05.175678 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.wsgi [None req-7b8fef02-1dcc-46db-8933-d8705e62bb5c tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] HTTP exception thrown: Instance d57716e0-3826-4e42-ad25-42cd46585692 could not be found. Jul 13 02:39:05.176252 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-7b8fef02-1dcc-46db-8933-d8705e62bb5c tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Returning 404 to user: Instance d57716e0-3826-4e42-ad25-42cd46585692 could not be found. {{(pid=107262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:39:05.177064 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-7b8fef02-1dcc-46db-8933-d8705e62bb5c tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "GET /compute/v2.1/servers/d57716e0-3826-4e42-ad25-42cd46585692" status: 404 len: 111 microversion: 2.1 time: 0.062515 Jul 13 02:39:05.177595 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 557/1079] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:39:05 2021] GET /compute/v2.1/servers/d57716e0-3826-4e42-ad25-42cd46585692 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 13 02:39:06.459254 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-67a15868-7292-4dbe-8ac3-c2f6b7cef413 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] Calling method '.version_select at 0x7f4313066430>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:39:06.480527 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-67a15868-7292-4dbe-8ac3-c2f6b7cef413 tempest-TestVolumeBootPattern-348343923 tempest-TestVolumeBootPattern-348343923-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-96975266" status: 202 len: 0 microversion: 2.1 time: 0.024835 Jul 13 02:39:06.481288 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 558/1080] 10.222.0.32 () {58 vars in 1257 bytes} [Tue Jul 13 02:39:06 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-96975266 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 13 02:39:12.393132 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-9a692d1a-8b4d-4d3c-a208-35b24490424e tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:39:12.393826 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-9a692d1a-8b4d-4d3c-a208-35b24490424e tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:39:12.402567 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9a692d1a-8b4d-4d3c-a208-35b24490424e tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:12.403488 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9a692d1a-8b4d-4d3c-a208-35b24490424e tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:12.405342 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9a692d1a-8b4d-4d3c-a208-35b24490424e tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:12.406099 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-9a692d1a-8b4d-4d3c-a208-35b24490424e tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:12.413107 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:12.413107 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:39:12.498402 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.objects.instance [None req-9a692d1a-8b4d-4d3c-a208-35b24490424e tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lazy-loading 'flavor' on Instance uuid a6d9fd73-2a8e-4766-a108-2024b292795c {{(pid=107262) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Jul 13 02:39:12.518212 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:2557: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:12.518212 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: rows_updated = model_query(context, models.InstanceExtra).\ Jul 13 02:39:12.526685 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:12.526685 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:39:12.586783 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/update_match.py:472: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:12.586783 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = query.session.execute(update_stmt) Jul 13 02:39:12.606185 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3008: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:12.606185 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).\ Jul 13 02:39:12.617898 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-9a692d1a-8b4d-4d3c-a208-35b24490424e tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "POST /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c/action" status: 202 len: 0 microversion: 2.1 time: 0.229684 Jul 13 02:39:12.621817 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 559/1081] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:39:12 2021] POST /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 13 02:39:12.628055 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-aaee630c-16f4-4a90-8656-984c05f45948 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:39:12.628819 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-aaee630c-16f4-4a90-8656-984c05f45948 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:39:12.638552 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-aaee630c-16f4-4a90-8656-984c05f45948 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:12.638996 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-aaee630c-16f4-4a90-8656-984c05f45948 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:12.639902 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-aaee630c-16f4-4a90-8656-984c05f45948 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:12.640331 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-aaee630c-16f4-4a90-8656-984c05f45948 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:12.644531 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:12.644531 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:39:12.835060 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-aaee630c-16f4-4a90-8656-984c05f45948 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f53f7247a54158825bddc30b96b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8b5616059f43f097126facb22ac41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:39:12.837780 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:12.837780 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:39:12.844822 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-aaee630c-16f4-4a90-8656-984c05f45948 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c" status: 200 len: 1568 microversion: 2.1 time: 0.221746 Jul 13 02:39:12.845392 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 560/1082] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:39:12 2021] GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c => generated 1568 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:39:13.862413 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-3efd1a02-c788-408b-b25f-a8924cf8502b tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:39:13.863092 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-3efd1a02-c788-408b-b25f-a8924cf8502b tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:39:13.869071 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3efd1a02-c788-408b-b25f-a8924cf8502b tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:13.869511 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3efd1a02-c788-408b-b25f-a8924cf8502b tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:13.870299 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3efd1a02-c788-408b-b25f-a8924cf8502b tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:13.870738 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3efd1a02-c788-408b-b25f-a8924cf8502b tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:13.873532 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:13.873532 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:39:14.049140 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-3efd1a02-c788-408b-b25f-a8924cf8502b tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f53f7247a54158825bddc30b96b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8b5616059f43f097126facb22ac41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:39:14.051735 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:14.051735 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:39:14.058536 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-3efd1a02-c788-408b-b25f-a8924cf8502b tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c" status: 200 len: 1568 microversion: 2.1 time: 0.200368 Jul 13 02:39:14.059094 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 561/1083] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:39:13 2021] GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c => generated 1568 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:39:15.076019 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-f96333f9-1bc3-4d1a-8630-e157f8d52b0d tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:39:15.076629 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-f96333f9-1bc3-4d1a-8630-e157f8d52b0d tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:39:15.083358 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f96333f9-1bc3-4d1a-8630-e157f8d52b0d tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:15.083801 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f96333f9-1bc3-4d1a-8630-e157f8d52b0d tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:15.084566 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f96333f9-1bc3-4d1a-8630-e157f8d52b0d tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:15.084994 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f96333f9-1bc3-4d1a-8630-e157f8d52b0d tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:15.087857 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:15.087857 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:39:15.258216 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-f96333f9-1bc3-4d1a-8630-e157f8d52b0d tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f53f7247a54158825bddc30b96b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8b5616059f43f097126facb22ac41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:39:15.260820 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:15.260820 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:39:15.268773 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-f96333f9-1bc3-4d1a-8630-e157f8d52b0d tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c" status: 200 len: 1568 microversion: 2.1 time: 0.196357 Jul 13 02:39:15.269277 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 562/1084] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:39:15 2021] GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c => generated 1568 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:39:16.285884 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-b2cf489f-4874-477f-97fe-d34f71711fe6 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:39:16.286506 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-b2cf489f-4874-477f-97fe-d34f71711fe6 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:39:16.292293 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b2cf489f-4874-477f-97fe-d34f71711fe6 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:16.292739 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b2cf489f-4874-477f-97fe-d34f71711fe6 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:16.293507 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b2cf489f-4874-477f-97fe-d34f71711fe6 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:16.293940 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-b2cf489f-4874-477f-97fe-d34f71711fe6 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:16.296810 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:16.296810 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:39:16.465016 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-b2cf489f-4874-477f-97fe-d34f71711fe6 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f53f7247a54158825bddc30b96b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8b5616059f43f097126facb22ac41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:39:16.467312 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:16.467312 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:39:16.475047 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-b2cf489f-4874-477f-97fe-d34f71711fe6 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c" status: 200 len: 1568 microversion: 2.1 time: 0.193685 Jul 13 02:39:16.475621 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 563/1085] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:39:16 2021] GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c => generated 1568 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:39:17.493122 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-15445855-ac2e-4a4d-8627-26957f3bb37b tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:39:17.493774 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-15445855-ac2e-4a4d-8627-26957f3bb37b tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:39:17.499506 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-15445855-ac2e-4a4d-8627-26957f3bb37b tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:17.499955 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-15445855-ac2e-4a4d-8627-26957f3bb37b tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:17.501075 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-15445855-ac2e-4a4d-8627-26957f3bb37b tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:17.501509 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-15445855-ac2e-4a4d-8627-26957f3bb37b tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:17.504418 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:17.504418 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:39:17.675632 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-15445855-ac2e-4a4d-8627-26957f3bb37b tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f53f7247a54158825bddc30b96b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8b5616059f43f097126facb22ac41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:39:17.678209 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:17.678209 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:39:17.684940 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-15445855-ac2e-4a4d-8627-26957f3bb37b tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c" status: 200 len: 1568 microversion: 2.1 time: 0.195501 Jul 13 02:39:17.685505 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 564/1086] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:39:17 2021] GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c => generated 1568 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:39:18.701600 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-28c842f4-23a1-47da-b9b5-128f71260fbe tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:39:18.702292 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-28c842f4-23a1-47da-b9b5-128f71260fbe tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:39:18.708567 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-28c842f4-23a1-47da-b9b5-128f71260fbe tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:18.709011 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-28c842f4-23a1-47da-b9b5-128f71260fbe tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:18.709771 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-28c842f4-23a1-47da-b9b5-128f71260fbe tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:18.710239 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-28c842f4-23a1-47da-b9b5-128f71260fbe tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:18.713066 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:18.713066 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:39:18.884453 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-28c842f4-23a1-47da-b9b5-128f71260fbe tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f53f7247a54158825bddc30b96b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8b5616059f43f097126facb22ac41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:39:18.887250 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:18.887250 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:39:18.894679 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-28c842f4-23a1-47da-b9b5-128f71260fbe tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c" status: 200 len: 1568 microversion: 2.1 time: 0.196717 Jul 13 02:39:18.895251 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 565/1087] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:39:18 2021] GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c => generated 1568 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:39:19.912055 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-d52d1292-6e6c-49bd-9763-105ede314d58 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:39:19.912656 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-d52d1292-6e6c-49bd-9763-105ede314d58 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:39:19.918431 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d52d1292-6e6c-49bd-9763-105ede314d58 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:19.918881 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d52d1292-6e6c-49bd-9763-105ede314d58 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:19.919644 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d52d1292-6e6c-49bd-9763-105ede314d58 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:19.920079 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d52d1292-6e6c-49bd-9763-105ede314d58 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:19.922947 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:19.922947 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:39:20.091571 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-d52d1292-6e6c-49bd-9763-105ede314d58 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f53f7247a54158825bddc30b96b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8b5616059f43f097126facb22ac41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:39:20.094711 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:20.094711 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:39:20.101708 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-d52d1292-6e6c-49bd-9763-105ede314d58 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c" status: 200 len: 1568 microversion: 2.1 time: 0.193440 Jul 13 02:39:20.102313 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 566/1088] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:39:19 2021] GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c => generated 1568 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:39:21.118644 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-22d15407-7a80-40ab-bd89-c0a9b944f8cd tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:39:21.119242 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-22d15407-7a80-40ab-bd89-c0a9b944f8cd tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:39:21.125024 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-22d15407-7a80-40ab-bd89-c0a9b944f8cd tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:21.125474 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-22d15407-7a80-40ab-bd89-c0a9b944f8cd tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:21.126263 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-22d15407-7a80-40ab-bd89-c0a9b944f8cd tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:21.126704 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-22d15407-7a80-40ab-bd89-c0a9b944f8cd tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:21.129508 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:21.129508 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:39:21.302112 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-22d15407-7a80-40ab-bd89-c0a9b944f8cd tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f53f7247a54158825bddc30b96b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8b5616059f43f097126facb22ac41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:39:21.304656 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:21.304656 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:39:21.311520 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-22d15407-7a80-40ab-bd89-c0a9b944f8cd tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c" status: 200 len: 1568 microversion: 2.1 time: 0.196602 Jul 13 02:39:21.312076 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 567/1089] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:39:21 2021] GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c => generated 1568 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:39:22.328576 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-f4b83f05-83f2-4c5c-b09d-6ad87beab116 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:39:22.329219 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-f4b83f05-83f2-4c5c-b09d-6ad87beab116 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:39:22.334843 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f4b83f05-83f2-4c5c-b09d-6ad87beab116 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:22.335289 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f4b83f05-83f2-4c5c-b09d-6ad87beab116 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:22.336050 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f4b83f05-83f2-4c5c-b09d-6ad87beab116 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:22.336481 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f4b83f05-83f2-4c5c-b09d-6ad87beab116 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:22.339299 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:22.339299 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:39:22.509174 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-f4b83f05-83f2-4c5c-b09d-6ad87beab116 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f53f7247a54158825bddc30b96b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8b5616059f43f097126facb22ac41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:39:22.511749 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:22.511749 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:39:22.518802 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-f4b83f05-83f2-4c5c-b09d-6ad87beab116 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c" status: 200 len: 1568 microversion: 2.1 time: 0.194011 Jul 13 02:39:22.519369 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 568/1090] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:39:22 2021] GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c => generated 1568 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:39:23.535940 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-f087a2e3-5694-44a3-84ba-8daa55c27431 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:39:23.536611 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-f087a2e3-5694-44a3-84ba-8daa55c27431 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:39:23.542250 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f087a2e3-5694-44a3-84ba-8daa55c27431 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:23.542736 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f087a2e3-5694-44a3-84ba-8daa55c27431 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:23.543469 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f087a2e3-5694-44a3-84ba-8daa55c27431 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:23.543898 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f087a2e3-5694-44a3-84ba-8daa55c27431 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:23.546708 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:23.546708 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:39:23.721820 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-f087a2e3-5694-44a3-84ba-8daa55c27431 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f53f7247a54158825bddc30b96b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8b5616059f43f097126facb22ac41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:39:23.724372 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:23.724372 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:39:23.731195 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-f087a2e3-5694-44a3-84ba-8daa55c27431 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c" status: 200 len: 1568 microversion: 2.1 time: 0.199235 Jul 13 02:39:23.731755 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 569/1091] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:39:23 2021] GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c => generated 1568 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:39:24.747889 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-8d629456-39d6-4ce8-af7a-2f3c43100da4 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:39:24.748545 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-8d629456-39d6-4ce8-af7a-2f3c43100da4 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:39:24.754336 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8d629456-39d6-4ce8-af7a-2f3c43100da4 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:24.754784 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8d629456-39d6-4ce8-af7a-2f3c43100da4 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:24.755540 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8d629456-39d6-4ce8-af7a-2f3c43100da4 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:24.755969 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8d629456-39d6-4ce8-af7a-2f3c43100da4 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:24.758807 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:24.758807 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:39:24.929628 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-8d629456-39d6-4ce8-af7a-2f3c43100da4 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f53f7247a54158825bddc30b96b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8b5616059f43f097126facb22ac41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:39:24.932252 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:24.932252 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:39:24.939735 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-8d629456-39d6-4ce8-af7a-2f3c43100da4 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c" status: 200 len: 1568 microversion: 2.1 time: 0.195217 Jul 13 02:39:24.940309 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 570/1092] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:39:24 2021] GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c => generated 1568 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:39:25.957407 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-87ef0c98-eda2-4390-b89a-ab1cb5c864ce tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:39:25.958106 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-87ef0c98-eda2-4390-b89a-ab1cb5c864ce tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:39:25.963896 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-87ef0c98-eda2-4390-b89a-ab1cb5c864ce tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:25.964342 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-87ef0c98-eda2-4390-b89a-ab1cb5c864ce tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:25.965108 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-87ef0c98-eda2-4390-b89a-ab1cb5c864ce tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:25.965539 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-87ef0c98-eda2-4390-b89a-ab1cb5c864ce tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:25.968348 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:25.968348 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:39:26.138197 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-87ef0c98-eda2-4390-b89a-ab1cb5c864ce tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f53f7247a54158825bddc30b96b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8b5616059f43f097126facb22ac41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:39:26.141299 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:26.141299 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:39:26.148177 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-87ef0c98-eda2-4390-b89a-ab1cb5c864ce tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c" status: 200 len: 1509 microversion: 2.1 time: 0.195267 Jul 13 02:39:26.148748 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 571/1093] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:39:25 2021] GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c => generated 1509 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:39:26.164685 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-17833d15-570c-4d9f-b188-378251cba92d tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:39:26.165249 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-17833d15-570c-4d9f-b188-378251cba92d tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:39:26.170715 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-17833d15-570c-4d9f-b188-378251cba92d tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:26.171164 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-17833d15-570c-4d9f-b188-378251cba92d tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:26.171929 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-17833d15-570c-4d9f-b188-378251cba92d tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:26.172469 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-17833d15-570c-4d9f-b188-378251cba92d tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:26.175126 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:26.175126 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:39:26.240607 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:26.240607 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:39:26.298586 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/update_match.py:472: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:26.298586 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = query.session.execute(update_stmt) Jul 13 02:39:26.323808 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-17833d15-570c-4d9f-b188-378251cba92d tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "POST /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c/action" status: 202 len: 0 microversion: 2.1 time: 0.162455 Jul 13 02:39:26.324662 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 572/1094] 10.222.0.32 () {60 vars in 1278 bytes} [Tue Jul 13 02:39:26 2021] POST /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c/action => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 13 02:39:26.333125 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-30a7240f-2f92-4302-a750-98cc9025fd0f tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:39:26.333733 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-30a7240f-2f92-4302-a750-98cc9025fd0f tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:39:26.339600 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-30a7240f-2f92-4302-a750-98cc9025fd0f tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:26.340053 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-30a7240f-2f92-4302-a750-98cc9025fd0f tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:26.340828 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-30a7240f-2f92-4302-a750-98cc9025fd0f tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:26.341265 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-30a7240f-2f92-4302-a750-98cc9025fd0f tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:26.344959 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:26.344959 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:39:26.552578 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-30a7240f-2f92-4302-a750-98cc9025fd0f tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f53f7247a54158825bddc30b96b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8b5616059f43f097126facb22ac41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:39:26.555198 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:26.555198 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:39:26.561980 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-30a7240f-2f92-4302-a750-98cc9025fd0f tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c" status: 200 len: 1517 microversion: 2.1 time: 0.232403 Jul 13 02:39:26.562574 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 573/1095] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:39:26 2021] GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c => generated 1517 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 13 02:39:27.578211 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-701a1af7-fe41-4cdf-8bea-31627c3c5b91 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:39:27.579436 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-701a1af7-fe41-4cdf-8bea-31627c3c5b91 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:39:27.585557 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-701a1af7-fe41-4cdf-8bea-31627c3c5b91 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:27.586144 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-701a1af7-fe41-4cdf-8bea-31627c3c5b91 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:27.587070 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-701a1af7-fe41-4cdf-8bea-31627c3c5b91 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:27.587565 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-701a1af7-fe41-4cdf-8bea-31627c3c5b91 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:27.590351 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:27.590351 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:39:27.773256 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-701a1af7-fe41-4cdf-8bea-31627c3c5b91 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f53f7247a54158825bddc30b96b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8b5616059f43f097126facb22ac41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:39:27.775820 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:27.775820 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:39:27.783925 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-701a1af7-fe41-4cdf-8bea-31627c3c5b91 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c" status: 200 len: 1519 microversion: 2.1 time: 0.208966 Jul 13 02:39:27.784501 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 574/1096] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:39:27 2021] GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c => generated 1519 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:39:28.801094 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-8ba2bb08-0ac9-4c1a-9704-5d849f6251b9 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:39:28.801728 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-8ba2bb08-0ac9-4c1a-9704-5d849f6251b9 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:39:28.807441 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8ba2bb08-0ac9-4c1a-9704-5d849f6251b9 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:28.807882 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8ba2bb08-0ac9-4c1a-9704-5d849f6251b9 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:28.808634 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8ba2bb08-0ac9-4c1a-9704-5d849f6251b9 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:28.809058 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8ba2bb08-0ac9-4c1a-9704-5d849f6251b9 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:28.811863 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:28.811863 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:39:28.982213 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-8ba2bb08-0ac9-4c1a-9704-5d849f6251b9 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f53f7247a54158825bddc30b96b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8b5616059f43f097126facb22ac41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:39:28.984760 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:28.984760 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:39:28.992445 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-8ba2bb08-0ac9-4c1a-9704-5d849f6251b9 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c" status: 200 len: 1575 microversion: 2.1 time: 0.195367 Jul 13 02:39:28.993004 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 575/1097] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:39:28 2021] GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c => generated 1575 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:39:29.811790 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-332d0054-19cd-44db-8f25-cdf559479dd2 req-478f802b-df89-4440-9aad-e46083f8ea8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d9fd73-2a8e-4766-a108-2024b292795c", "name": "network-vif-unplugged", "status": "completed", "tag": "dcb6c645-5585-4723-9633-6f29ebaddeb8"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:39:29.813724 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:39:29.813724 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:39:29.821118 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-332d0054-19cd-44db-8f25-cdf559479dd2 req-478f802b-df89-4440-9aad-e46083f8ea8b service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:29.821595 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-332d0054-19cd-44db-8f25-cdf559479dd2 req-478f802b-df89-4440-9aad-e46083f8ea8b service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:29.833956 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-332d0054-19cd-44db-8f25-cdf559479dd2 req-478f802b-df89-4440-9aad-e46083f8ea8b service nova] Creating event network-vif-unplugged:dcb6c645-5585-4723-9633-6f29ebaddeb8 for instance a6d9fd73-2a8e-4766-a108-2024b292795c on hv-cinder-78102 Jul 13 02:39:29.839700 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-332d0054-19cd-44db-8f25-cdf559479dd2 req-478f802b-df89-4440-9aad-e46083f8ea8b service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.153745 Jul 13 02:39:29.840348 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 576/1098] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:39:29 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 02:39:30.010611 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-ce0deb31-24c9-4490-abe3-00d676617b53 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:39:30.011230 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-ce0deb31-24c9-4490-abe3-00d676617b53 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:39:30.018694 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ce0deb31-24c9-4490-abe3-00d676617b53 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:30.019136 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ce0deb31-24c9-4490-abe3-00d676617b53 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:30.019908 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ce0deb31-24c9-4490-abe3-00d676617b53 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:30.020338 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-ce0deb31-24c9-4490-abe3-00d676617b53 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:30.023336 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:30.023336 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:39:30.212407 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-ce0deb31-24c9-4490-abe3-00d676617b53 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f53f7247a54158825bddc30b96b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8b5616059f43f097126facb22ac41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:39:30.215061 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:30.215061 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:39:30.222348 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-ce0deb31-24c9-4490-abe3-00d676617b53 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c" status: 200 len: 1575 microversion: 2.1 time: 0.215810 Jul 13 02:39:30.222937 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 577/1099] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:39:30 2021] GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c => generated 1575 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:39:31.239521 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-c08f7cfc-495e-472b-bf38-5356838e34f1 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:39:31.240122 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-c08f7cfc-495e-472b-bf38-5356838e34f1 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:39:31.245953 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c08f7cfc-495e-472b-bf38-5356838e34f1 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:31.246422 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c08f7cfc-495e-472b-bf38-5356838e34f1 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:31.247171 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c08f7cfc-495e-472b-bf38-5356838e34f1 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:31.247596 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-c08f7cfc-495e-472b-bf38-5356838e34f1 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:31.250430 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:31.250430 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:39:31.421447 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-c08f7cfc-495e-472b-bf38-5356838e34f1 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f53f7247a54158825bddc30b96b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8b5616059f43f097126facb22ac41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:39:31.424320 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:31.424320 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:39:31.437094 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-c08f7cfc-495e-472b-bf38-5356838e34f1 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c" status: 200 len: 1575 microversion: 2.1 time: 0.201717 Jul 13 02:39:31.437658 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 578/1100] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:39:31 2021] GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c => generated 1575 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:39:31.854269 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-6d8b4cbf-1d78-4f44-af51-405814dc54cf req-2fa0d8db-2828-4c46-b455-8f0aa72755f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d9fd73-2a8e-4766-a108-2024b292795c", "name": "network-vif-plugged", "status": "completed", "tag": "dcb6c645-5585-4723-9633-6f29ebaddeb8"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:39:31.855794 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:39:31.855794 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:39:31.863046 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-6d8b4cbf-1d78-4f44-af51-405814dc54cf req-2fa0d8db-2828-4c46-b455-8f0aa72755f6 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:31.863485 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-6d8b4cbf-1d78-4f44-af51-405814dc54cf req-2fa0d8db-2828-4c46-b455-8f0aa72755f6 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:31.873875 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-6d8b4cbf-1d78-4f44-af51-405814dc54cf req-2fa0d8db-2828-4c46-b455-8f0aa72755f6 service nova] Creating event network-vif-plugged:dcb6c645-5585-4723-9633-6f29ebaddeb8 for instance a6d9fd73-2a8e-4766-a108-2024b292795c on hv-cinder-78102 Jul 13 02:39:31.879227 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-6d8b4cbf-1d78-4f44-af51-405814dc54cf req-2fa0d8db-2828-4c46-b455-8f0aa72755f6 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028579 Jul 13 02:39:31.879782 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 579/1101] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:39:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 02:39:32.455594 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-db7a8388-8a3a-4704-a821-6612d8e36c6c tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:39:32.456281 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-db7a8388-8a3a-4704-a821-6612d8e36c6c tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:39:32.462227 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-db7a8388-8a3a-4704-a821-6612d8e36c6c tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:32.462669 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-db7a8388-8a3a-4704-a821-6612d8e36c6c tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:32.463415 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-db7a8388-8a3a-4704-a821-6612d8e36c6c tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:32.463840 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-db7a8388-8a3a-4704-a821-6612d8e36c6c tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:32.466637 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:32.466637 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:39:32.639745 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-db7a8388-8a3a-4704-a821-6612d8e36c6c tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f53f7247a54158825bddc30b96b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8b5616059f43f097126facb22ac41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:39:32.642615 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:32.642615 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:39:32.649359 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-db7a8388-8a3a-4704-a821-6612d8e36c6c tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c" status: 200 len: 1575 microversion: 2.1 time: 0.198157 Jul 13 02:39:32.649914 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 580/1102] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:39:32 2021] GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c => generated 1575 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:39:33.666400 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-f707a1d3-9362-4855-9fc1-051580cd873d tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:39:33.667013 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-f707a1d3-9362-4855-9fc1-051580cd873d tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:39:33.672601 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f707a1d3-9362-4855-9fc1-051580cd873d tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:33.673469 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f707a1d3-9362-4855-9fc1-051580cd873d tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:33.674263 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f707a1d3-9362-4855-9fc1-051580cd873d tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:33.674696 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f707a1d3-9362-4855-9fc1-051580cd873d tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:33.677494 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:33.677494 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:39:33.848057 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-f707a1d3-9362-4855-9fc1-051580cd873d tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f53f7247a54158825bddc30b96b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8b5616059f43f097126facb22ac41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:39:33.850610 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:33.850610 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:39:33.857371 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-f707a1d3-9362-4855-9fc1-051580cd873d tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c" status: 200 len: 1575 microversion: 2.1 time: 0.194649 Jul 13 02:39:33.857927 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 581/1103] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:39:33 2021] GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c => generated 1575 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:39:34.874690 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-a40a6cd1-de67-4cb4-a4d5-6fdaca724330 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:39:34.875332 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-a40a6cd1-de67-4cb4-a4d5-6fdaca724330 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:39:34.882056 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a40a6cd1-de67-4cb4-a4d5-6fdaca724330 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:34.882514 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a40a6cd1-de67-4cb4-a4d5-6fdaca724330 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:34.883297 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a40a6cd1-de67-4cb4-a4d5-6fdaca724330 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:34.883724 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-a40a6cd1-de67-4cb4-a4d5-6fdaca724330 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:34.886551 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:34.886551 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:39:35.057357 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-a40a6cd1-de67-4cb4-a4d5-6fdaca724330 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f53f7247a54158825bddc30b96b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8b5616059f43f097126facb22ac41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:39:35.059904 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:35.059904 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:39:35.067304 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-a40a6cd1-de67-4cb4-a4d5-6fdaca724330 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c" status: 200 len: 1575 microversion: 2.1 time: 0.196316 Jul 13 02:39:35.067865 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 582/1104] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:39:34 2021] GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c => generated 1575 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:39:36.084992 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-d8e2268f-ee93-406b-ad85-3ed24dec1674 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:39:36.085617 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-d8e2268f-ee93-406b-ad85-3ed24dec1674 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:39:36.091407 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d8e2268f-ee93-406b-ad85-3ed24dec1674 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:36.091847 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d8e2268f-ee93-406b-ad85-3ed24dec1674 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:36.092593 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d8e2268f-ee93-406b-ad85-3ed24dec1674 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:36.093064 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-d8e2268f-ee93-406b-ad85-3ed24dec1674 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:36.096262 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:36.096262 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:39:36.268748 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-d8e2268f-ee93-406b-ad85-3ed24dec1674 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f53f7247a54158825bddc30b96b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8b5616059f43f097126facb22ac41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:39:36.271303 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:39:36.271303 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:39:36.278749 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-d8e2268f-ee93-406b-ad85-3ed24dec1674 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c" status: 200 len: 1562 microversion: 2.1 time: 0.197370 Jul 13 02:39:36.279312 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 583/1105] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:39:36 2021] GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c => generated 1562 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:39:38.155684 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-7787f151-7702-4cd5-8dae-c1fe847e209f req-04a7cac9-518a-42ee-869a-e573ece34a60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6d9fd73-2a8e-4766-a108-2024b292795c", "name": "network-vif-plugged", "status": "completed", "tag": "dcb6c645-5585-4723-9633-6f29ebaddeb8"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:39:38.157193 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:39:38.157193 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:39:38.164558 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-7787f151-7702-4cd5-8dae-c1fe847e209f req-04a7cac9-518a-42ee-869a-e573ece34a60 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:39:38.165003 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-7787f151-7702-4cd5-8dae-c1fe847e209f req-04a7cac9-518a-42ee-869a-e573ece34a60 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:39:38.175703 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-7787f151-7702-4cd5-8dae-c1fe847e209f req-04a7cac9-518a-42ee-869a-e573ece34a60 service nova] Creating event network-vif-plugged:dcb6c645-5585-4723-9633-6f29ebaddeb8 for instance a6d9fd73-2a8e-4766-a108-2024b292795c on hv-cinder-78102 Jul 13 02:39:38.180666 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-7787f151-7702-4cd5-8dae-c1fe847e209f req-04a7cac9-518a-42ee-869a-e573ece34a60 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028625 Jul 13 02:39:38.181251 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 584/1106] 10.222.0.32 () {64 vars in 1318 bytes} [Tue Jul 13 02:39:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 13 02:40:49.841262 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: ERROR oslo.messaging._drivers.impl_rabbit [-] [fde8e23d-5763-437f-90c7-2cd0eebfc6a8] AMQP server on 10.222.0.32:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 13 02:40:49.845107 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-f989b337-054d-46be-91a7-4d762f379b13 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:40:49.845680 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-f989b337-054d-46be-91a7-4d762f379b13 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:40:49.851633 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f989b337-054d-46be-91a7-4d762f379b13 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:40:49.852713 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f989b337-054d-46be-91a7-4d762f379b13 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:40:49.853565 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f989b337-054d-46be-91a7-4d762f379b13 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:40:49.853991 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-f989b337-054d-46be-91a7-4d762f379b13 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:40:49.856839 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:40:49.856839 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:40:49.919296 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-f989b337-054d-46be-91a7-4d762f379b13 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Going to try to terminate instance {{(pid=107262) delete /opt/stack/nova/nova/compute/api.py:2542}} Jul 13 02:40:49.921524 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3008: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:40:49.921524 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).\ Jul 13 02:40:49.934807 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:40:49.934807 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:40:49.994596 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/update_match.py:472: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:40:49.994596 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = query.session.execute(update_stmt) Jul 13 02:40:50.010471 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:530: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:40:50.010471 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = model_query(context, models.Service, read_deleted="no").\ Jul 13 02:40:50.044467 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-f989b337-054d-46be-91a7-4d762f379b13 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "DELETE /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c" status: 204 len: 0 microversion: 2.1 time: 0.204717 Jul 13 02:40:50.048047 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 585/1107] 10.222.0.32 () {58 vars in 1239 bytes} [Tue Jul 13 02:40:49 2021] DELETE /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 13 02:40:50.053742 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-8256feab-7552-4fa0-adaf-44e41ae65506 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:40:50.054477 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-8256feab-7552-4fa0-adaf-44e41ae65506 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:40:50.060144 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8256feab-7552-4fa0-adaf-44e41ae65506 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:40:50.060596 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8256feab-7552-4fa0-adaf-44e41ae65506 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:40:50.061372 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8256feab-7552-4fa0-adaf-44e41ae65506 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:40:50.061797 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-8256feab-7552-4fa0-adaf-44e41ae65506 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:40:50.064713 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:40:50.064713 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:40:50.240959 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-8256feab-7552-4fa0-adaf-44e41ae65506 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f53f7247a54158825bddc30b96b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8b5616059f43f097126facb22ac41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:40:50.244199 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:40:50.244199 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:40:50.251132 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-8256feab-7552-4fa0-adaf-44e41ae65506 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c" status: 200 len: 1568 microversion: 2.1 time: 0.201661 Jul 13 02:40:50.251712 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 586/1108] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:40:50 2021] GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c => generated 1568 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:40:51.267952 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-85e6731f-8887-4ce0-9cc6-448a31e4e8b1 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:40:51.268622 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-85e6731f-8887-4ce0-9cc6-448a31e4e8b1 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:40:51.285031 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-85e6731f-8887-4ce0-9cc6-448a31e4e8b1 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:40:51.285473 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-85e6731f-8887-4ce0-9cc6-448a31e4e8b1 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:40:51.286260 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-85e6731f-8887-4ce0-9cc6-448a31e4e8b1 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:40:51.286688 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-85e6731f-8887-4ce0-9cc6-448a31e4e8b1 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:40:51.290504 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:40:51.290504 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:40:51.316669 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO oslo.messaging._drivers.impl_rabbit [-] [fde8e23d-5763-437f-90c7-2cd0eebfc6a8] Reconnected to AMQP server on 10.222.0.32:5672 via [amqp] client with port 44796. Jul 13 02:40:51.462600 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-85e6731f-8887-4ce0-9cc6-448a31e4e8b1 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f53f7247a54158825bddc30b96b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8b5616059f43f097126facb22ac41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:40:51.465166 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:40:51.465166 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:40:51.472004 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-85e6731f-8887-4ce0-9cc6-448a31e4e8b1 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c" status: 200 len: 1568 microversion: 2.1 time: 0.207809 Jul 13 02:40:51.472570 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 587/1109] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:40:51 2021] GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c => generated 1568 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:40:52.489151 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-dd973f1f-71dc-4314-a26b-ec5081c70d48 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:40:52.489820 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-dd973f1f-71dc-4314-a26b-ec5081c70d48 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:40:52.496333 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-dd973f1f-71dc-4314-a26b-ec5081c70d48 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:40:52.496773 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-dd973f1f-71dc-4314-a26b-ec5081c70d48 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:40:52.497543 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-dd973f1f-71dc-4314-a26b-ec5081c70d48 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:40:52.497969 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-dd973f1f-71dc-4314-a26b-ec5081c70d48 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:40:52.501176 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:40:52.501176 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:40:52.617900 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.policy [None req-dd973f1f-71dc-4314-a26b-ec5081c70d48 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70f53f7247a54158825bddc30b96b4f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c8b5616059f43f097126facb22ac41a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=107262) authorize /opt/stack/nova/nova/policy.py:199}} Jul 13 02:40:52.620875 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:3000: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:40:52.620875 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: return _block_device_mapping_get_query(context).filter( Jul 13 02:40:52.628052 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-dd973f1f-71dc-4314-a26b-ec5081c70d48 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c" status: 200 len: 1219 microversion: 2.1 time: 0.143091 Jul 13 02:40:52.628827 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 588/1110] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:40:52 2021] GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c => generated 1219 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:40:53.644671 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-3f0a019e-f0e7-4261-9679-e54e407abac6 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Calling method '>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:40:53.645296 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.compute.api [None req-3f0a019e-f0e7-4261-9679-e54e407abac6 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] [instance: a6d9fd73-2a8e-4766-a108-2024b292795c] Fetching instance by UUID {{(pid=107262) get /opt/stack/nova/nova/compute/api.py:2793}} Jul 13 02:40:53.651660 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3f0a019e-f0e7-4261-9679-e54e407abac6 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:40:53.652109 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3f0a019e-f0e7-4261-9679-e54e407abac6 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:40:53.652871 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3f0a019e-f0e7-4261-9679-e54e407abac6 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:40:53.653304 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [None req-3f0a019e-f0e7-4261-9679-e54e407abac6 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:40:53.656232 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /opt/stack/nova/nova/db/sqlalchemy/api.py:1385: SAWarning: TypeDecorator SoftDeleteInteger() will not produce a cache key because the ``cache_ok`` flag is not set to True. Set this flag to True if this type object's state is safe to use in a cache key, or False to disable this warning. Jul 13 02:40:53.656232 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: result = _build_instance_get(context, columns_to_join=columns_to_join).\ Jul 13 02:40:53.700077 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.wsgi [None req-3f0a019e-f0e7-4261-9679-e54e407abac6 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] HTTP exception thrown: Instance a6d9fd73-2a8e-4766-a108-2024b292795c could not be found. Jul 13 02:40:53.700659 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-3f0a019e-f0e7-4261-9679-e54e407abac6 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Returning 404 to user: Instance a6d9fd73-2a8e-4766-a108-2024b292795c could not be found. {{(pid=107262) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Jul 13 02:40:53.701484 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-3f0a019e-f0e7-4261-9679-e54e407abac6 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c" status: 404 len: 111 microversion: 2.1 time: 0.060501 Jul 13 02:40:53.702048 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 589/1111] 10.222.0.32 () {58 vars in 1236 bytes} [Tue Jul 13 02:40:53 2021] GET /compute/v2.1/servers/a6d9fd73-2a8e-4766-a108-2024b292795c => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 13 02:40:53.856140 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [None req-547c61ce-2baf-4fa7-9577-c76838807042 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] Calling method '.version_select at 0x7f43130c6820>' {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 13 02:40:53.874481 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [None req-547c61ce-2baf-4fa7-9577-c76838807042 tempest-TestShelveInstance-1419753436 tempest-TestShelveInstance-1419753436-project] 10.222.0.32 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1258503872" status: 202 len: 0 microversion: 2.1 time: 0.021830 Jul 13 02:40:53.874989 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 590/1112] 10.222.0.32 () {58 vars in 1254 bytes} [Tue Jul 13 02:40:53 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1258503872 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 13 02:42:01.635654 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG nova.api.openstack.wsgi [req-964f308e-a2de-4a98-a7e5-08a1a5495cbd req-6dc7946e-ef38-41be-a0f3-10c02123ee47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d582c4f0-83ee-44d8-9c24-679c870c79ba", "tag": "bfbda5b3-4dd0-4554-96bb-91ee7c0e20c0"}, {"name": "network-changed", "server_uuid": "d582c4f0-83ee-44d8-9c24-679c870c79ba", "tag": "bfbda5b3-4dd0-4554-96bb-91ee7c0e20c0"}, {"name": "network-changed", "server_uuid": "d582c4f0-83ee-44d8-9c24-679c870c79ba", "tag": "bfbda5b3-4dd0-4554-96bb-91ee7c0e20c0"}, {"server_uuid": "d582c4f0-83ee-44d8-9c24-679c870c79ba", "name": "network-vif-deleted", "tag": "bfbda5b3-4dd0-4554-96bb-91ee7c0e20c0"}, {"name": "network-changed", "server_uuid": "7d96b396-3586-4250-aa00-46948258c2bd", "tag": "740bf26b-031b-45ff-bd93-aaac93efe690"}, {"server_uuid": "7d96b396-3586-4250-aa00-46948258c2bd", "name": "network-vif-deleted", "tag": "740bf26b-031b-45ff-bd93-aaac93efe690"}, {"name": "network-changed", "server_uuid": "a6d9fd73-2a8e-4766-a108-2024b292795c", "tag": "dcb6c645-5585-4723-9633-6f29ebaddeb8"}, {"server_uuid": "a6d9fd73-2a8e-4766-a108-2024b292795c", "name": "network-vif-deleted", "tag": "dcb6c645-5585-4723-9633-6f29ebaddeb8"}]} {{(pid=107262) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 13 02:42:01.638692 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 13 02:42:01.638692 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: warnings.warn(msg) Jul 13 02:42:01.650622 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-964f308e-a2de-4a98-a7e5-08a1a5495cbd req-6dc7946e-ef38-41be-a0f3-10c02123ee47 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Jul 13 02:42:01.651055 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: DEBUG oslo_concurrency.lockutils [req-964f308e-a2de-4a98-a7e5-08a1a5495cbd req-6dc7946e-ef38-41be-a0f3-10c02123ee47 service nova] Lock "94e222e8-b2ee-400d-b98b-1757bb81f73f" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=107262) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Jul 13 02:42:01.663978 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-964f308e-a2de-4a98-a7e5-08a1a5495cbd req-6dc7946e-ef38-41be-a0f3-10c02123ee47 service nova] Creating event network-changed:bfbda5b3-4dd0-4554-96bb-91ee7c0e20c0 for instance d582c4f0-83ee-44d8-9c24-679c870c79ba on hv-cinder-78102 Jul 13 02:42:01.664477 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-964f308e-a2de-4a98-a7e5-08a1a5495cbd req-6dc7946e-ef38-41be-a0f3-10c02123ee47 service nova] Creating event network-changed:bfbda5b3-4dd0-4554-96bb-91ee7c0e20c0 for instance d582c4f0-83ee-44d8-9c24-679c870c79ba on hv-cinder-78102 Jul 13 02:42:01.664969 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-964f308e-a2de-4a98-a7e5-08a1a5495cbd req-6dc7946e-ef38-41be-a0f3-10c02123ee47 service nova] Creating event network-changed:bfbda5b3-4dd0-4554-96bb-91ee7c0e20c0 for instance d582c4f0-83ee-44d8-9c24-679c870c79ba on hv-cinder-78102 Jul 13 02:42:01.665457 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-964f308e-a2de-4a98-a7e5-08a1a5495cbd req-6dc7946e-ef38-41be-a0f3-10c02123ee47 service nova] Creating event network-vif-deleted:bfbda5b3-4dd0-4554-96bb-91ee7c0e20c0 for instance d582c4f0-83ee-44d8-9c24-679c870c79ba on hv-cinder-78102 Jul 13 02:42:01.665942 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-964f308e-a2de-4a98-a7e5-08a1a5495cbd req-6dc7946e-ef38-41be-a0f3-10c02123ee47 service nova] Creating event network-changed:740bf26b-031b-45ff-bd93-aaac93efe690 for instance 7d96b396-3586-4250-aa00-46948258c2bd on hv-cinder-78102 Jul 13 02:42:01.666495 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-964f308e-a2de-4a98-a7e5-08a1a5495cbd req-6dc7946e-ef38-41be-a0f3-10c02123ee47 service nova] Creating event network-vif-deleted:740bf26b-031b-45ff-bd93-aaac93efe690 for instance 7d96b396-3586-4250-aa00-46948258c2bd on hv-cinder-78102 Jul 13 02:42:01.666978 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-964f308e-a2de-4a98-a7e5-08a1a5495cbd req-6dc7946e-ef38-41be-a0f3-10c02123ee47 service nova] Creating event network-changed:dcb6c645-5585-4723-9633-6f29ebaddeb8 for instance a6d9fd73-2a8e-4766-a108-2024b292795c on hv-cinder-78102 Jul 13 02:42:01.667496 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.compute.server_external_events [req-964f308e-a2de-4a98-a7e5-08a1a5495cbd req-6dc7946e-ef38-41be-a0f3-10c02123ee47 service nova] Creating event network-vif-deleted:dcb6c645-5585-4723-9633-6f29ebaddeb8 for instance a6d9fd73-2a8e-4766-a108-2024b292795c on hv-cinder-78102 Jul 13 02:42:01.676670 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO nova.api.openstack.requestlog [req-964f308e-a2de-4a98-a7e5-08a1a5495cbd req-6dc7946e-ef38-41be-a0f3-10c02123ee47 service nova] 10.222.0.32 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1360 microversion: 2.1 time: 0.182305 Jul 13 02:42:01.677262 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: [pid: 107262|app: 0|req: 591/1113] 10.222.0.32 () {64 vars in 1319 bytes} [Tue Jul 13 02:42:01 2021] POST /compute/v2.1/os-server-external-events => generated 1360 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 13 02:43:46.529596 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Jul 13 02:43:46.530340 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: Tue Jul 13 02:43:46 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 13 02:45:17.101820 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 13 02:45:17.102470 dv-cinder-781024-2-iscsi devstack@n-api.service[107262]: Tue Jul 13 02:45:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!